2024-04-14T10:47:06.152 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-14T10:47:06.152 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds-quiesce 2-workunit/fs/snaps}} --name leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi --verbose -- /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/orig.config.yaml 2024-04-14T10:47:06.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T10:47:06.295 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds-quiesce 2-workunit/fs/snaps}} email: null first_in_suite: false job_id: '7655737' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: 605eb1656ce49fe7fede4f53b18852ac638918c7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 605eb1656ce49fe7fede4f53b18852ac638918c7 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 605eb1656ce49fe7fede4f53b18852ac638918c7 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 9221 sha1: 605eb1656ce49fe7fede4f53b18852ac638918c7 sleep_before_teardown: 0 subset: 111/1000 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 605eb1656ce49fe7fede4f53b18852ac638918c7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXgyYh0ntcjU8Q459AY3n7Iy8nRUlizN+SFU6IxhlTAdkPxg7SdyoP2RcWQcndzZPIILjYaPUOOxHUJyDl7nI= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHxc0VyijjfhsK9GoLH1aUcoMgGCukbOhBrp6uQVoaAN6ShVhDEAB+e4WE/d0UYQAt1wM/kPxZaa+m59lxNS3c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-14_10:39:28 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-14T10:47:06.295 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa; will attempt to use it 2024-04-14T10:47:06.296 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks 2024-04-14T10:47:06.296 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-14T10:47:06.298 INFO:teuthology.task.internal:Checking packages... 2024-04-14T10:47:06.322 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '605eb1656ce49fe7fede4f53b18852ac638918c7' 2024-04-14T10:47:06.322 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-14T10:47:06.322 INFO:teuthology.packaging:ref: None 2024-04-14T10:47:06.322 INFO:teuthology.packaging:tag: None 2024-04-14T10:47:06.322 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-14T10:47:06.322 INFO:teuthology.packaging:sha1: 605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:47:06.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-14T10:47:06.467 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2765.g605eb165 2024-04-14T10:47:06.468 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-14T10:47:06.475 INFO:teuthology.task.internal:no buildpackages task found 2024-04-14T10:47:06.475 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-14T10:47:06.495 INFO:teuthology.task.internal:Saving configuration 2024-04-14T10:47:06.514 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-14T10:47:06.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T10:47:06.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 10:42:00.065194', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXgyYh0ntcjU8Q459AY3n7Iy8nRUlizN+SFU6IxhlTAdkPxg7SdyoP2RcWQcndzZPIILjYaPUOOxHUJyDl7nI='} 2024-04-14T10:47:06.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 10:42:00.067083', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHxc0VyijjfhsK9GoLH1aUcoMgGCukbOhBrp6uQVoaAN6ShVhDEAB+e4WE/d0UYQAt1wM/kPxZaa+m59lxNS3c='} 2024-04-14T10:47:06.561 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-14T10:47:06.568 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-14T10:47:06.568 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-14T10:47:06.568 INFO:teuthology.run_tasks:Running task console_log... 2024-04-14T10:47:06.637 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f76d94570d0>, signals=[15]) 2024-04-14T10:47:06.637 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-14T10:47:06.644 INFO:teuthology.task.internal:Opening connections... 2024-04-14T10:47:06.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T10:47:06.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:47:06.734 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T10:47:06.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:47:06.824 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-14T10:47:06.831 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-04-14T10:47:06.849 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-04-14T10:47:06.849 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-14T10:47:06.905 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-14T10:47:06.906 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T10:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T10:47:06.907 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T10:47:06.907 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-14T10:47:06.932 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-14T10:47:06.949 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-14T10:47:06.950 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-14T10:47:07.006 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T10:47:07.007 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-14T10:47:07.007 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T10:47:07.007 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T10:47:07.007 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T10:47:07.007 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-14T10:47:07.023 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-14T10:47:07.032 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-14T10:47:07.042 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-14T10:47:07.042 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-04-14T10:47:07.044 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-14T10:47:07.062 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-14T10:47:07.068 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-14T10:47:07.068 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-04-14T10:47:07.101 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-14T10:47:07.365 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-14T10:47:07.417 INFO:teuthology.run_tasks:Running task kernel... 2024-04-14T10:47:07.433 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-14T10:47:07.433 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-14T10:47:07.433 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T10:47:07.434 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T10:47:07.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:47:07.450 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-04-14T10:47:07.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:47:07.451 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-14T10:47:07.507 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-361.el9.x86_64 2024-04-14T10:47:07.507 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.14.0-361.el9.x86_64 2024-04-14T10:47:07.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-04-14T10:47:07.508 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-361.el9.x86_64 2024-04-14T10:47:07.509 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-361.el9.x86_64 2024-04-14T10:47:07.509 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-04-14T10:47:10.151 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - AppStream 7.7 MB/s | 8.1 MB 00:01 2024-04-14T10:47:10.249 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - AppStream 7.1 MB/s | 8.1 MB 00:01 2024-04-14T10:47:12.199 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.5 MB 00:00 2024-04-14T10:47:12.268 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - BaseOS 3.2 MB/s | 2.5 MB 00:00 2024-04-14T10:47:13.106 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-04-14T10:47:15.057 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-14T10:47:15.408 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.0 MB 00:02 2024-04-14T10:47:24.006 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.2 MB 00:05 2024-04-14T10:47:25.548 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:09 2024-04-14T10:47:25.565 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-04-14T10:47:29.153 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 21 MB 00:03 2024-04-14T10:47:31.074 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-04-14T10:47:32.657 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-14T10:47:33.550 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-04-14T10:47:34.283 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-14T10:47:36.541 INFO:teuthology.orchestra.run.smithi084.stderr:Modular dependency problems: 2024-04-14T10:47:36.541 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-14T10:47:36.541 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 1: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 2: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 3: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 4: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 5: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 6: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 7: conflicting requests 2024-04-14T10:47:36.542 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 8: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 9: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 10: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 11: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 12: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 13: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 14: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 15: conflicting requests 2024-04-14T10:47:36.543 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 16: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 17: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 18: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 19: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 20: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 21: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 22: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 23: conflicting requests 2024-04-14T10:47:36.544 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 24: conflicting requests 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 25: conflicting requests 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 26: conflicting requests 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 27: conflicting requests 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 28: conflicting requests 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 29: conflicting requests 2024-04-14T10:47:36.545 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 30: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 31: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 32: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 33: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 34: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 35: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 36: conflicting requests 2024-04-14T10:47:36.546 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 37: conflicting requests 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 39: conflicting requests 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.547 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.548 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.549 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:47:36.550 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.550 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.550 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.550 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:47:36.931 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T10:47:36.931 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T10:47:37.043 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-14T10:47:37.054 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:47:37.055 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 77 M 2024-04-14T10:47:37.056 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 123 M 2024-04-14T10:47:37.056 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-14T10:47:37.292 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 2.2 MB/s | 214 kB 00:00 2024-04-14T10:47:37.892 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 22 MB/s | 15 MB 00:00 2024-04-14T10:47:38.317 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 27 MB/s | 28 MB 00:01 2024-04-14T10:47:38.651 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-04-14T10:47:38.701 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 22 MB/s | 34 MB 00:01 2024-04-14T10:47:38.701 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:47:38.701 INFO:teuthology.orchestra.run.smithi084.stdout:Total 47 MB/s | 77 MB 00:01 2024-04-14T10:47:39.369 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-14T10:47:39.728 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-14T10:47:39.728 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-14T10:47:40.767 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-14T10:47:40.767 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:Modular dependency problems: 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 1: conflicting requests 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 2: conflicting requests 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.905 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 3: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 4: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 5: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 6: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 7: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 8: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 9: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 10: conflicting requests 2024-04-14T10:47:40.906 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 11: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 12: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 13: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 14: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 15: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 16: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 17: conflicting requests 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.907 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 18: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 19: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 20: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 21: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 22: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 23: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 24: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 25: conflicting requests 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.908 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 26: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 27: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 28: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 29: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 30: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 31: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 32: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 33: conflicting requests 2024-04-14T10:47:40.909 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 34: conflicting requests 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 35: conflicting requests 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 36: conflicting requests 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 37: conflicting requests 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.910 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 39: conflicting requests 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:47:40.911 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.912 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:47:40.913 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:47:41.274 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T10:47:41.274 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T10:47:41.384 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-04-14T10:47:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout:Install 4 Packages 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:47:41.392 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 77 M 2024-04-14T10:47:41.393 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 123 M 2024-04-14T10:47:41.393 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-14T10:47:41.827 INFO:teuthology.orchestra.run.smithi175.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 1.2 MB/s | 214 kB 00:00 2024-04-14T10:47:42.427 INFO:teuthology.orchestra.run.smithi175.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 20 MB/s | 15 MB 00:00 2024-04-14T10:47:43.250 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-14T10:47:43.610 INFO:teuthology.orchestra.run.smithi175.stdout:(3/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 17 MB/s | 34 MB 00:01 2024-04-14T10:47:43.828 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T10:47:43.909 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T10:47:44.219 INFO:teuthology.orchestra.run.smithi175.stdout:(4/4): kernel-modules-core-5.14.0-435.el9.x86_6 12 MB/s | 28 MB 00:02 2024-04-14T10:47:44.219 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:47:44.219 INFO:teuthology.orchestra.run.smithi175.stdout:Total 27 MB/s | 77 MB 00:02 2024-04-14T10:47:44.896 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-14T10:47:45.263 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-14T10:47:45.263 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-14T10:47:46.306 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-14T10:47:46.306 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-14T10:47:46.693 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T10:47:46.821 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T10:47:48.765 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-14T10:47:49.394 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T10:47:49.485 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T10:47:51.526 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T10:47:51.638 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:47:52.250 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T10:47:52.377 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T10:47:56.354 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:47:57.111 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T10:47:57.210 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:01.959 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:25.606 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:25.606 INFO:teuthology.orchestra.run.smithi084.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T10:48:25.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:48:25.652 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:26.044 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:26.044 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T10:48:26.044 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T10:48:26.044 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T10:48:26.506 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:26.506 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:48:26.506 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-14T10:48:26.506 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T10:48:26.507 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T10:48:26.507 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T10:48:26.507 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T10:48:26.507 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:48:26.507 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-14T10:48:26.874 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T10:48:26.971 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T10:48:26.972 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T10:48:26.972 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T10:48:26.973 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T10:48:26.973 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T10:48:26.973 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-14T10:48:26.973 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T10:48:26.973 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T10:48:27.054 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T10:48:27.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T10:48:27.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-04-14T10:48:27.102 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-04-14T10:48:27.102 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 68.el9 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8264254 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-04-14T10:48:27.103 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:48:27.104 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T10:48:27.105 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T10:48:27.105 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 5.14.0-435.el9.x86_64 2024-04-14T10:48:27.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T10:48:27.706 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-04-14T10:48:29.064 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T10:48:29.100 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-04-14T10:48:29.103 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-04-14T10:48:29.118 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.bvW5B2Tc64 2024-04-14T10:48:29.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bvW5B2Tc64 2024-04-14T10:48:29.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.bvW5B2Tc64 2024-04-14T10:48:29.325 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.bvW5B2Tc64 is 6KB 2024-04-14T10:48:29.374 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.bvW5B2Tc64 2024-04-14T10:48:29.388 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T10:48:29.452 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T10:48:29.452 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T10:48:29.452 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T10:48:29.453 INFO:teuthology.orchestra.run.smithi084.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T10:48:29.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T10:48:29.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-04-14T10:48:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:31.218 INFO:teuthology.orchestra.run.smithi175.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T10:48:31.218 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:48:31.263 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:31.645 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:31.645 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T10:48:31.645 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T10:48:31.645 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T10:48:32.091 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T10:48:32.091 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:48:32.091 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-04-14T10:48:32.092 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T10:48:32.092 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T10:48:32.092 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T10:48:32.092 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T10:48:32.092 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:48:32.092 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-14T10:48:32.427 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T10:48:32.580 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T10:48:32.581 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T10:48:32.581 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T10:48:32.581 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T10:48:32.581 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T10:48:32.581 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-14T10:48:32.581 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T10:48:32.582 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T10:48:32.663 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T10:48:32.663 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T10:48:32.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 68.el9 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8264254 2024-04-14T10:48:32.701 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T10:48:32.702 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2024-04-14T10:48:32.703 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:48:32.703 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T10:48:32.703 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T10:48:32.704 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 5.14.0-435.el9.x86_64 2024-04-14T10:48:32.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T10:48:33.321 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-04-14T10:48:34.632 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T10:48:34.661 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-04-14T10:48:34.664 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-14T10:48:34.679 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.V50xSDrgEh 2024-04-14T10:48:34.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V50xSDrgEh 2024-04-14T10:48:34.747 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.V50xSDrgEh 2024-04-14T10:48:34.892 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.V50xSDrgEh is 6KB 2024-04-14T10:48:34.941 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.V50xSDrgEh 2024-04-14T10:48:34.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T10:48:35.023 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T10:48:35.023 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T10:48:35.023 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T10:48:35.023 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T10:48:35.025 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T10:48:35.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-04-14T10:48:59.643 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-14T10:48:59.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-14T10:48:59.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:49:05.172 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-14T10:49:05.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-14T10:49:05.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:49:39.871 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-14T10:49:48.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-14T10:49:48.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:49:59.654 DEBUG:teuthology.orchestra.remote:timed out 2024-04-14T10:50:07.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-14T10:50:08.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-14T10:50:08.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:50:10.389 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-14T10:50:10.827 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-14T10:50:10.827 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-435.el9.x86_64"... 2024-04-14T10:50:10.827 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-04-14T10:50:10.841 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-435.el9.x86_64 2024-04-14T10:50:10.842 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T10:50:10.842 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T10:50:10.842 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T10:50:11.842 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-14T10:50:11.843 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-14T10:50:11.922 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-04-14T10:50:11.950 DEBUG:teuthology.parallel:result is None 2024-04-14T10:50:19.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-14T10:50:19.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:50:19.674 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-14T10:50:20.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-14T10:50:20.186 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-435.el9.x86_64"... 2024-04-14T10:50:20.186 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-14T10:50:20.201 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-435.el9.x86_64 2024-04-14T10:50:20.202 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T10:50:20.202 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T10:50:20.202 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T10:50:21.202 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-14T10:50:21.203 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-14T10:50:21.293 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-04-14T10:50:21.340 DEBUG:teuthology.parallel:result is None 2024-04-14T10:50:21.340 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-14T10:50:21.347 INFO:teuthology.task.internal:Creating test directory... 2024-04-14T10:50:21.348 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T10:50:21.351 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T10:50:21.366 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-14T10:50:21.373 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-14T10:50:21.380 INFO:teuthology.task.internal:Creating archive directory... 2024-04-14T10:50:21.380 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T10:50:21.410 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T10:50:21.463 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-14T10:50:21.470 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-14T10:50:21.471 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T10:50:21.473 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T10:50:21.503 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T10:50:21.509 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T10:50:21.517 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T10:50:21.522 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T10:50:21.524 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-14T10:50:21.531 INFO:teuthology.task.internal:Configuring sudo... 2024-04-14T10:50:21.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T10:50:21.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T10:50:21.592 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-14T10:50:21.601 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-14T10:50:21.601 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T10:50:21.634 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T10:50:21.648 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T10:50:21.733 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T10:50:21.782 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T10:50:21.866 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T10:50:21.907 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:50:21.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T10:50:21.974 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T10:50:22.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T10:50:22.070 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T10:50:22.147 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T10:50:22.195 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:50:22.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T10:50:22.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-04-14T10:50:22.267 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-14T10:50:22.316 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:50:22.347 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:50:22.823 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-14T10:50:22.831 INFO:teuthology.task.internal:Starting timer... 2024-04-14T10:50:22.832 INFO:teuthology.run_tasks:Running task pcp... 2024-04-14T10:50:22.847 INFO:teuthology.run_tasks:Running task selinux... 2024-04-14T10:50:22.857 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-14T10:50:22.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-04-14T10:50:22.909 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-04-14T10:50:22.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-04-14T10:50:22.959 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-04-14T10:50:22.962 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-14T10:50:22.962 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-04-14T10:50:23.001 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-04-14T10:50:23.002 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-04-14T10:50:23.029 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-04-14T10:50:23.029 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-04-14T10:50:23.029 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:50:23.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:50:23.071 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:50:23.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:50:23.099 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-14T10:50:23.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-04-14T10:50:23.145 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-04-14T10:50:23.189 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-14T10:50:23.199 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-14T10:50:23.223 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-14T10:50:23.225 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-14T10:55:01.849 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-14T10:55:01.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-14T10:55:01.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:55:01.960 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-14T10:55:02.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-14T10:55:02.045 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-14T10:55:02.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:55:02.138 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-14T10:55:02.218 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-14T10:55:02.219 INFO:teuthology.run_tasks:Running task clock... 2024-04-14T10:55:02.230 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-14T10:55:02.230 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T10:55:02.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:55:02.233 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T10:55:02.233 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:55:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T10:55:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T10:55:02.291 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T10:55:02.307 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-04-14T10:55:02.309 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T10:55:02.320 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-04-14T10:55:02.337 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T10:55:02.339 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-04-14T10:55:02.353 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-04-14T10:55:02.353 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T10:55:02.369 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T10:55:02.386 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T10:55:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:55:02.404 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:55:02.404 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-04-14T10:55:02.404 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.404 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.405 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.405 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.445 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:55:02.449 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:55:02.449 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-14T10:55:02.449 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.449 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.449 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.449 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:55:02.450 INFO:teuthology.run_tasks:Running task install... 2024-04-14T10:55:02.461 DEBUG:teuthology.task.install:project ceph 2024-04-14T10:55:02.462 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7'}} 2024-04-14T10:55:02.462 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7'} 2024-04-14T10:55:02.462 INFO:teuthology.task.install:Using flavor: default 2024-04-14T10:55:02.486 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-14T10:55:02.486 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-14T10:55:02.487 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7', 'tag': None, 'wait_for_package': False} 2024-04-14T10:55:02.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:55:02.491 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7', 'tag': None, 'wait_for_package': False} 2024-04-14T10:55:02.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:55:02.724 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/ 2024-04-14T10:55:02.724 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2765.g605eb165 2024-04-14T10:55:02.731 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/ 2024-04-14T10:55:02.731 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2765.g605eb165 2024-04-14T10:55:02.841 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T10:55:02.841 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:55:02.841 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T10:55:02.870 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T10:55:02.870 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/605eb1656ce49fe7fede4f53b18852ac638918c7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T10:55:02.905 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/605eb1656ce49fe7fede4f53b18852ac638918c7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T10:55:02.905 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:55:02.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T10:55:02.933 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T10:55:02.933 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/605eb1656ce49fe7fede4f53b18852ac638918c7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T10:55:02.937 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T10:55:03.001 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T10:55:03.016 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T10:55:03.082 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T10:55:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-04-14T10:55:03.084 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-04-14T10:55:03.151 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-04-14T10:55:03.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-04-14T10:55:03.328 INFO:teuthology.orchestra.run.smithi175.stdout:74 files removed 2024-04-14T10:55:03.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T10:55:03.392 INFO:teuthology.orchestra.run.smithi084.stdout:74 files removed 2024-04-14T10:55:03.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T10:55:04.000 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 245 kB/s | 83 kB 00:00 2024-04-14T10:55:04.113 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 212 kB/s | 83 kB 00:00 2024-04-14T10:55:04.414 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 32 kB/s | 11 kB 00:00 2024-04-14T10:55:04.472 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-14T10:55:04.776 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2024-04-14T10:55:04.814 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-04-14T10:55:05.286 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-14T10:55:05.334 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-14T10:55:06.922 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.5 MB 00:00 2024-04-14T10:55:06.967 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS-9 - BaseOS 8.0 MB/s | 2.5 MB 00:00 2024-04-14T10:55:07.921 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-14T10:55:08.733 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.0 MB 00:01 2024-04-14T10:55:11.242 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-14T10:55:14.955 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 19 MB 00:05 2024-04-14T10:55:15.502 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.2 MB 00:00 2024-04-14T10:55:16.910 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 16 kB 00:00 2024-04-14T10:55:18.237 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-04-14T10:55:19.730 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-04-14T10:55:21.139 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 16 kB 00:00 2024-04-14T10:55:22.735 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-14T10:55:23.445 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 8.8 kB/s | 1.7 kB 00:00 2024-04-14T10:55:26.012 INFO:teuthology.orchestra.run.smithi084.stderr:Modular dependency problems: 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 1: conflicting requests 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 2: conflicting requests 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 3: conflicting requests 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 4: conflicting requests 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 5: conflicting requests 2024-04-14T10:55:26.013 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 6: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 7: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 8: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 9: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 10: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 11: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 12: conflicting requests 2024-04-14T10:55:26.014 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 13: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 14: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 15: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 16: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 17: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 18: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 19: conflicting requests 2024-04-14T10:55:26.015 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 20: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 21: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 22: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 23: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 24: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 25: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 26: conflicting requests 2024-04-14T10:55:26.016 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 27: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 28: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 29: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 30: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 31: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 32: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 33: conflicting requests 2024-04-14T10:55:26.017 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 34: conflicting requests 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 35: conflicting requests 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 36: conflicting requests 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 37: conflicting requests 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.018 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 39: conflicting requests 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.019 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.020 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.021 INFO:teuthology.orchestra.run.smithi084.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:55:26.498 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:55:26.499 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:55:26.512 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T10:55:26.513 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T10:55:26.514 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T10:55:26.516 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T10:55:26.518 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:55:26.520 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T10:55:26.522 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T10:55:26.614 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-14T10:55:26.636 INFO:teuthology.orchestra.run.smithi084.stdout:========================================================================================= 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout:========================================================================================= 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.0.0-2765.g605eb165.el9 ceph 6.6 k 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.0.0-2765.g605eb165.el9 ceph 5.4 M 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.0.0-2765.g605eb165.el9 ceph 890 k 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2765.g605eb165.el9 ceph 145 k 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.0.0-2765.g605eb165.el9 ceph 1.5 M 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 141 k 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 3.5 M 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 7.4 M 2024-04-14T10:55:26.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 49 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.0.0-2765.g605eb165.el9 ceph 10 M 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.0.0-2765.g605eb165.el9 ceph 49 M 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 264 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 762 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.0.0-2765.g605eb165.el9 ceph 225 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.0.0-2765.g605eb165.el9 ceph 27 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 18 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.0.0-2765.g605eb165.el9 ceph 32 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 746 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.0.0-2765.g605eb165.el9 ceph 127 k 2024-04-14T10:55:26.638 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.0.0-2765.g605eb165.el9 ceph 162 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.0.0-2765.g605eb165.el9 ceph 320 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.0.0-2765.g605eb165.el9 ceph 298 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.0.0-2765.g605eb165.el9 ceph 99 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.0.0-2765.g605eb165.el9 ceph 85 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.0.0-2765.g605eb165.el9 ceph 3.1 M 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.0.0-2765.g605eb165.el9 ceph 170 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-04-14T10:55:26.639 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 3.4 M 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 3.1 M 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T10:55:26.640 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.0.0-2765.g605eb165.el9 ceph 21 M 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 34 k 2024-04-14T10:55:26.641 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.0.0-2765.g605eb165.el9 ceph 2.4 M 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 249 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.0.0-2765.g605eb165.el9 ceph 4.7 M 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.0.0-2765.g605eb165.el9 ceph 17 M 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 16 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.0.0-2765.g605eb165.el9 ceph 25 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T10:55:26.642 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.0.0-2765.g605eb165.el9 ceph 164 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 500 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 5.2 M 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T10:55:26.643 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T10:55:26.644 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.0.0-2765.g605eb165.el9 ceph 45 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.0.0-2765.g605eb165.el9 ceph 135 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T10:55:26.645 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T10:55:26.646 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T10:55:26.647 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T10:55:26.648 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-14T10:55:26.649 INFO:teuthology.orchestra.run.smithi084.stdout:========================================================================================= 2024-04-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi084.stdout:Install 150 Packages 2024-04-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 24 Packages 2024-04-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 229 M 2024-04-14T10:55:26.650 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-14T10:55:27.715 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-14T10:55:27.729 INFO:teuthology.orchestra.run.smithi084.stdout:(1/174): ceph-19.0.0-2765.g605eb165.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-04-14T10:55:28.529 INFO:teuthology.orchestra.run.smithi084.stdout:(2/174): ceph-fuse-19.0.0-2765.g605eb165.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-14T10:55:28.746 INFO:teuthology.orchestra.run.smithi084.stdout:(3/174): ceph-base-19.0.0-2765.g605eb165.el9.x8 4.0 MB/s | 5.4 MB 00:01 2024-04-14T10:55:28.771 INFO:teuthology.orchestra.run.smithi084.stdout:(4/174): ceph-immutable-object-cache-19.0.0-276 600 kB/s | 145 kB 00:00 2024-04-14T10:55:29.163 INFO:teuthology.orchestra.run.smithi084.stdout:(5/174): ceph-mds-19.0.0-2765.g605eb165.el9.x86 5.7 MB/s | 2.4 MB 00:00 2024-04-14T10:55:29.880 INFO:teuthology.orchestra.run.smithi084.stdout:(6/174): ceph-mon-19.0.0-2765.g605eb165.el9.x86 6.6 MB/s | 4.7 MB 00:00 2024-04-14T10:55:29.964 INFO:teuthology.orchestra.run.smithi084.stdout:(7/174): ceph-mgr-19.0.0-2765.g605eb165.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr:Modular dependency problems: 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 1: conflicting requests 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 2: conflicting requests 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 3: conflicting requests 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 4: conflicting requests 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.291 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 5: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 6: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 7: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 8: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 9: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 10: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 11: conflicting requests 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.292 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 12: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 13: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 14: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 15: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 16: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 17: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 18: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 19: conflicting requests 2024-04-14T10:55:30.293 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 20: conflicting requests 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 21: conflicting requests 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 22: conflicting requests 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 23: conflicting requests 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 24: conflicting requests 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 25: conflicting requests 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.294 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 26: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 27: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 28: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 29: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 30: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 31: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 32: conflicting requests 2024-04-14T10:55:30.295 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 33: conflicting requests 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 34: conflicting requests 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 35: conflicting requests 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 36: conflicting requests 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 37: conflicting requests 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.296 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 39: conflicting requests 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.297 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.298 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.299 INFO:teuthology.orchestra.run.smithi175.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:55:30.737 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:55:30.738 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:55:30.751 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T10:55:30.752 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T10:55:30.753 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T10:55:30.754 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T10:55:30.756 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:55:30.759 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T10:55:30.760 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T10:55:30.852 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-14T10:55:30.880 INFO:teuthology.orchestra.run.smithi175.stdout:========================================================================================= 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout:========================================================================================= 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-2765.g605eb165.el9 ceph 6.6 k 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-2765.g605eb165.el9 ceph 5.4 M 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-2765.g605eb165.el9 ceph 890 k 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2765.g605eb165.el9 ceph 145 k 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-2765.g605eb165.el9 ceph 1.5 M 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 141 k 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 3.5 M 2024-04-14T10:55:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 7.4 M 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 49 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-2765.g605eb165.el9 ceph 10 M 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-2765.g605eb165.el9 ceph 49 M 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 264 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 762 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-2765.g605eb165.el9 ceph 225 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-2765.g605eb165.el9 ceph 27 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 18 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-2765.g605eb165.el9 ceph 32 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 746 k 2024-04-14T10:55:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-2765.g605eb165.el9 ceph 127 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-2765.g605eb165.el9 ceph 162 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-2765.g605eb165.el9 ceph 320 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-2765.g605eb165.el9 ceph 298 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-2765.g605eb165.el9 ceph 99 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-2765.g605eb165.el9 ceph 85 k 2024-04-14T10:55:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-2765.g605eb165.el9 ceph 3.1 M 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-2765.g605eb165.el9 ceph 170 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T10:55:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 3.4 M 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 3.1 M 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T10:55:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-2765.g605eb165.el9 ceph 21 M 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 34 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-2765.g605eb165.el9 ceph 2.4 M 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 249 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-2765.g605eb165.el9 ceph 4.7 M 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-2765.g605eb165.el9 ceph 17 M 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2765.g605eb165.el9 ceph-noarch 16 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-2765.g605eb165.el9 ceph 25 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T10:55:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-2765.g605eb165.el9 ceph 164 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T10:55:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 500 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-2765.g605eb165.el9 ceph 5.2 M 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T10:55:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-2765.g605eb165.el9 ceph 45 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-2765.g605eb165.el9 ceph 135 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T10:55:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T10:55:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T10:55:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T10:55:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T10:55:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout:========================================================================================= 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout:Install 150 Packages 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 24 Packages 2024-04-14T10:55:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:55:30.895 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 229 M 2024-04-14T10:55:30.895 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-14T10:55:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:(1/174): ceph-19.0.0-2765.g605eb165.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-04-14T10:55:31.974 INFO:teuthology.orchestra.run.smithi084.stdout:(8/174): ceph-common-19.0.0-2765.g605eb165.el9. 4.6 MB/s | 21 MB 00:04 2024-04-14T10:55:32.105 INFO:teuthology.orchestra.run.smithi084.stdout:(9/174): ceph-selinux-19.0.0-2765.g605eb165.el9 189 kB/s | 25 kB 00:00 2024-04-14T10:55:33.050 INFO:teuthology.orchestra.run.smithi175.stdout:(2/174): ceph-base-19.0.0-2765.g605eb165.el9.x8 3.5 MB/s | 5.4 MB 00:01 2024-04-14T10:55:33.109 INFO:teuthology.orchestra.run.smithi175.stdout:(3/174): ceph-fuse-19.0.0-2765.g605eb165.el9.x8 727 kB/s | 890 kB 00:01 2024-04-14T10:55:33.152 INFO:teuthology.orchestra.run.smithi175.stdout:(4/174): ceph-immutable-object-cache-19.0.0-276 1.4 MB/s | 145 kB 00:00 2024-04-14T10:55:33.417 INFO:teuthology.orchestra.run.smithi175.stdout:(5/174): ceph-mgr-19.0.0-2765.g605eb165.el9.x86 5.6 MB/s | 1.5 MB 00:00 2024-04-14T10:55:33.556 INFO:teuthology.orchestra.run.smithi084.stdout:(10/174): ceph-osd-19.0.0-2765.g605eb165.el9.x8 4.6 MB/s | 17 MB 00:03 2024-04-14T10:55:33.731 INFO:teuthology.orchestra.run.smithi084.stdout:(11/174): cephfs-mirror-19.0.0-2765.g605eb165.e 1.3 MB/s | 225 kB 00:00 2024-04-14T10:55:33.939 INFO:teuthology.orchestra.run.smithi084.stdout:(12/174): cephfs-shell-19.0.0-2765.g605eb165.el 130 kB/s | 27 kB 00:00 2024-04-14T10:55:34.031 INFO:teuthology.orchestra.run.smithi084.stdout:(13/174): libcephfs-devel-19.0.0-2765.g605eb165 347 kB/s | 32 kB 00:00 2024-04-14T10:55:34.068 INFO:teuthology.orchestra.run.smithi175.stdout:(6/174): ceph-mon-19.0.0-2765.g605eb165.el9.x86 7.2 MB/s | 4.7 MB 00:00 2024-04-14T10:55:34.265 INFO:teuthology.orchestra.run.smithi084.stdout:(14/174): libcephfs2-19.0.0-2765.g605eb165.el9. 3.1 MB/s | 746 kB 00:00 2024-04-14T10:55:34.398 INFO:teuthology.orchestra.run.smithi084.stdout:(15/174): libcephsqlite-19.0.0-2765.g605eb165.e 1.2 MB/s | 164 kB 00:00 2024-04-14T10:55:34.524 INFO:teuthology.orchestra.run.smithi084.stdout:(16/174): librados-devel-19.0.0-2765.g605eb165. 1.0 MB/s | 127 kB 00:00 2024-04-14T10:55:34.699 INFO:teuthology.orchestra.run.smithi084.stdout:(17/174): libradosstriper1-19.0.0-2765.g605eb16 2.8 MB/s | 500 kB 00:00 2024-04-14T10:55:35.634 INFO:teuthology.orchestra.run.smithi175.stdout:(7/174): ceph-mds-19.0.0-2765.g605eb165.el9.x86 957 kB/s | 2.4 MB 00:02 2024-04-14T10:55:35.766 INFO:teuthology.orchestra.run.smithi084.stdout:(18/174): librgw2-19.0.0-2765.g605eb165.el9.x86 4.9 MB/s | 5.2 MB 00:01 2024-04-14T10:55:35.824 INFO:teuthology.orchestra.run.smithi084.stdout:(19/174): python3-ceph-argparse-19.0.0-2765.g60 777 kB/s | 45 kB 00:00 2024-04-14T10:55:35.891 INFO:teuthology.orchestra.run.smithi084.stdout:(20/174): python3-ceph-common-19.0.0-2765.g605e 2.0 MB/s | 135 kB 00:00 2024-04-14T10:55:35.943 INFO:teuthology.orchestra.run.smithi175.stdout:(8/174): ceph-common-19.0.0-2765.g605eb165.el9. 4.7 MB/s | 21 MB 00:04 2024-04-14T10:55:35.975 INFO:teuthology.orchestra.run.smithi084.stdout:(21/174): python3-cephfs-19.0.0-2765.g605eb165. 1.9 MB/s | 162 kB 00:00 2024-04-14T10:55:36.135 INFO:teuthology.orchestra.run.smithi175.stdout:(9/174): ceph-osd-19.0.0-2765.g605eb165.el9.x86 8.1 MB/s | 17 MB 00:02 2024-04-14T10:55:36.160 INFO:teuthology.orchestra.run.smithi175.stdout:(10/174): ceph-selinux-19.0.0-2765.g605eb165.el 116 kB/s | 25 kB 00:00 2024-04-14T10:55:36.317 INFO:teuthology.orchestra.run.smithi084.stdout:(22/174): python3-rados-19.0.0-2765.g605eb165.e 938 kB/s | 320 kB 00:00 2024-04-14T10:55:36.344 INFO:teuthology.orchestra.run.smithi175.stdout:(11/174): cephfs-mirror-19.0.0-2765.g605eb165.e 1.2 MB/s | 225 kB 00:00 2024-04-14T10:55:36.427 INFO:teuthology.orchestra.run.smithi175.stdout:(12/174): cephfs-shell-19.0.0-2765.g605eb165.el 325 kB/s | 27 kB 00:00 2024-04-14T10:55:36.442 INFO:teuthology.orchestra.run.smithi084.stdout:(23/174): python3-rbd-19.0.0-2765.g605eb165.el9 2.3 MB/s | 298 kB 00:00 2024-04-14T10:55:36.486 INFO:teuthology.orchestra.run.smithi175.stdout:(13/174): libcephfs-devel-19.0.0-2765.g605eb165 545 kB/s | 32 kB 00:00 2024-04-14T10:55:36.542 INFO:teuthology.orchestra.run.smithi084.stdout:(24/174): python3-rgw-19.0.0-2765.g605eb165.el9 995 kB/s | 99 kB 00:00 2024-04-14T10:55:36.611 INFO:teuthology.orchestra.run.smithi175.stdout:(14/174): libcephfs2-19.0.0-2765.g605eb165.el9. 5.8 MB/s | 746 kB 00:00 2024-04-14T10:55:36.617 INFO:teuthology.orchestra.run.smithi084.stdout:(25/174): rbd-fuse-19.0.0-2765.g605eb165.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-14T10:55:36.678 INFO:teuthology.orchestra.run.smithi175.stdout:(15/174): libcephsqlite-19.0.0-2765.g605eb165.e 2.4 MB/s | 164 kB 00:00 2024-04-14T10:55:36.737 INFO:teuthology.orchestra.run.smithi175.stdout:(16/174): librados-devel-19.0.0-2765.g605eb165. 2.1 MB/s | 127 kB 00:00 2024-04-14T10:55:36.862 INFO:teuthology.orchestra.run.smithi175.stdout:(17/174): libradosstriper1-19.0.0-2765.g605eb16 3.9 MB/s | 500 kB 00:00 2024-04-14T10:55:37.084 INFO:teuthology.orchestra.run.smithi084.stdout:(26/174): rbd-mirror-19.0.0-2765.g605eb165.el9. 6.6 MB/s | 3.1 MB 00:00 2024-04-14T10:55:37.176 INFO:teuthology.orchestra.run.smithi084.stdout:(27/174): rbd-nbd-19.0.0-2765.g605eb165.el9.x86 1.8 MB/s | 170 kB 00:00 2024-04-14T10:55:37.252 INFO:teuthology.orchestra.run.smithi084.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2765.g 457 kB/s | 34 kB 00:00 2024-04-14T10:55:37.360 INFO:teuthology.orchestra.run.smithi084.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2765.g605eb16 1.3 MB/s | 141 kB 00:00 2024-04-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi175.stdout:(18/174): librgw2-19.0.0-2765.g605eb165.el9.x86 8.4 MB/s | 5.2 MB 00:00 2024-04-14T10:55:37.546 INFO:teuthology.orchestra.run.smithi175.stdout:(19/174): python3-ceph-argparse-19.0.0-2765.g60 775 kB/s | 45 kB 00:00 2024-04-14T10:55:37.621 INFO:teuthology.orchestra.run.smithi175.stdout:(20/174): python3-ceph-common-19.0.0-2765.g605e 1.8 MB/s | 135 kB 00:00 2024-04-14T10:55:37.688 INFO:teuthology.orchestra.run.smithi175.stdout:(21/174): python3-cephfs-19.0.0-2765.g605eb165. 2.4 MB/s | 162 kB 00:00 2024-04-14T10:55:37.763 INFO:teuthology.orchestra.run.smithi175.stdout:(22/174): python3-rados-19.0.0-2765.g605eb165.e 4.2 MB/s | 320 kB 00:00 2024-04-14T10:55:37.836 INFO:teuthology.orchestra.run.smithi084.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2765.g605eb 7.4 MB/s | 3.5 MB 00:00 2024-04-14T10:55:37.838 INFO:teuthology.orchestra.run.smithi175.stdout:(23/174): python3-rbd-19.0.0-2765.g605eb165.el9 3.9 MB/s | 298 kB 00:00 2024-04-14T10:55:37.989 INFO:teuthology.orchestra.run.smithi175.stdout:(24/174): python3-rgw-19.0.0-2765.g605eb165.el9 662 kB/s | 99 kB 00:00 2024-04-14T10:55:38.056 INFO:teuthology.orchestra.run.smithi175.stdout:(25/174): rbd-fuse-19.0.0-2765.g605eb165.el9.x8 1.3 MB/s | 85 kB 00:00 2024-04-14T10:55:38.565 INFO:teuthology.orchestra.run.smithi175.stdout:(26/174): rbd-mirror-19.0.0-2765.g605eb165.el9. 6.1 MB/s | 3.1 MB 00:00 2024-04-14T10:55:38.623 INFO:teuthology.orchestra.run.smithi175.stdout:(27/174): rbd-nbd-19.0.0-2765.g605eb165.el9.x86 2.9 MB/s | 170 kB 00:00 2024-04-14T10:55:38.690 INFO:teuthology.orchestra.run.smithi175.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2765.g 516 kB/s | 34 kB 00:00 2024-04-14T10:55:38.791 INFO:teuthology.orchestra.run.smithi175.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2765.g605eb16 1.4 MB/s | 141 kB 00:00 2024-04-14T10:55:38.819 INFO:teuthology.orchestra.run.smithi084.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-04-14T10:55:38.894 INFO:teuthology.orchestra.run.smithi084.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2765.g60 3.3 MB/s | 249 kB 00:00 2024-04-14T10:55:38.978 INFO:teuthology.orchestra.run.smithi084.stdout:(33/174): ceph-mgr-rook-19.0.0-2765.g605eb165.e 593 kB/s | 49 kB 00:00 2024-04-14T10:55:39.070 INFO:teuthology.orchestra.run.smithi084.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2765.g6 179 kB/s | 16 kB 00:00 2024-04-14T10:55:39.204 INFO:teuthology.orchestra.run.smithi084.stdout:(35/174): ceph-volume-19.0.0-2765.g605eb165.el9 1.9 MB/s | 264 kB 00:00 2024-04-14T10:55:39.233 INFO:teuthology.orchestra.run.smithi175.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2765.g605eb 8.0 MB/s | 3.5 MB 00:00 2024-04-14T10:55:39.321 INFO:teuthology.orchestra.run.smithi084.stdout:(36/174): cephadm-19.0.0-2765.g605eb165.el9.noa 6.4 MB/s | 762 kB 00:00 2024-04-14T10:55:39.429 INFO:teuthology.orchestra.run.smithi084.stdout:(37/174): ceph-radosgw-19.0.0-2765.g605eb165.el 1.1 MB/s | 10 MB 00:09 2024-04-14T10:55:39.446 INFO:teuthology.orchestra.run.smithi084.stdout:(38/174): cephfs-top-19.0.0-2765.g605eb165.el9. 146 kB/s | 18 kB 00:00 2024-04-14T10:55:39.521 INFO:teuthology.orchestra.run.smithi084.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 192 kB/s | 18 kB 00:00 2024-04-14T10:55:39.597 INFO:teuthology.orchestra.run.smithi084.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 534 kB/s | 80 kB 00:00 2024-04-14T10:55:39.705 INFO:teuthology.orchestra.run.smithi084.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-14T10:55:39.789 INFO:teuthology.orchestra.run.smithi084.stdout:(42/174): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-04-14T10:55:39.814 INFO:teuthology.orchestra.run.smithi084.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-14T10:55:39.890 INFO:teuthology.orchestra.run.smithi084.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 218 kB 00:00 2024-04-14T10:55:39.915 INFO:teuthology.orchestra.run.smithi084.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-14T10:55:39.933 INFO:teuthology.orchestra.run.smithi175.stdout:(31/174): ceph-test-19.0.0-2765.g605eb165.el9.x 13 MB/s | 49 MB 00:03 2024-04-14T10:55:39.974 INFO:teuthology.orchestra.run.smithi084.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-14T10:55:39.983 INFO:teuthology.orchestra.run.smithi175.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2765.g60 4.9 MB/s | 249 kB 00:00 2024-04-14T10:55:40.032 INFO:teuthology.orchestra.run.smithi084.stdout:(47/174): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-14T10:55:40.033 INFO:teuthology.orchestra.run.smithi175.stdout:(33/174): ceph-mgr-rook-19.0.0-2765.g605eb165.e 987 kB/s | 49 kB 00:00 2024-04-14T10:55:40.084 INFO:teuthology.orchestra.run.smithi175.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2765.g6 329 kB/s | 16 kB 00:00 2024-04-14T10:55:40.091 INFO:teuthology.orchestra.run.smithi084.stdout:(48/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-14T10:55:40.133 INFO:teuthology.orchestra.run.smithi084.stdout:(49/174): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-04-14T10:55:40.158 INFO:teuthology.orchestra.run.smithi084.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-14T10:55:40.209 INFO:teuthology.orchestra.run.smithi175.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 7.6 MB/s | 7.4 MB 00:00 2024-04-14T10:55:40.234 INFO:teuthology.orchestra.run.smithi175.stdout:(36/174): ceph-volume-19.0.0-2765.g605eb165.el9 1.7 MB/s | 264 kB 00:00 2024-04-14T10:55:40.285 INFO:teuthology.orchestra.run.smithi175.stdout:(37/174): cephadm-19.0.0-2765.g605eb165.el9.noa 9.9 MB/s | 762 kB 00:00 2024-04-14T10:55:40.310 INFO:teuthology.orchestra.run.smithi175.stdout:(38/174): cephfs-top-19.0.0-2765.g605eb165.el9. 242 kB/s | 18 kB 00:00 2024-04-14T10:55:40.510 INFO:teuthology.orchestra.run.smithi175.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 78 kB/s | 18 kB 00:00 2024-04-14T10:55:40.927 INFO:teuthology.orchestra.run.smithi175.stdout:(40/174): jq-1.6-16.el9.x86_64.rpm 449 kB/s | 187 kB 00:00 2024-04-14T10:55:41.286 INFO:teuthology.orchestra.run.smithi175.stdout:(41/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-04-14T10:55:41.300 INFO:teuthology.orchestra.run.smithi084.stdout:(51/174): automake-1.16.2-8.el9.noarch.rpm 590 kB/s | 689 kB 00:01 2024-04-14T10:55:41.411 INFO:teuthology.orchestra.run.smithi175.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-04-14T10:55:41.425 INFO:teuthology.orchestra.run.smithi084.stdout:(52/174): bison-3.7.4-5.el9.x86_64.rpm 744 kB/s | 943 kB 00:01 2024-04-14T10:55:41.517 INFO:teuthology.orchestra.run.smithi084.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 235 kB/s | 21 kB 00:00 2024-04-14T10:55:41.544 INFO:teuthology.orchestra.run.smithi175.stdout:(43/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.6 MB/s | 218 kB 00:00 2024-04-14T10:55:41.551 INFO:teuthology.orchestra.run.smithi084.stdout:(54/174): boost-program-options-1.75.0-8.el9.x8 427 kB/s | 107 kB 00:00 2024-04-14T10:55:41.618 INFO:teuthology.orchestra.run.smithi084.stdout:(55/174): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-04-14T10:55:41.628 INFO:teuthology.orchestra.run.smithi175.stdout:(44/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-14T10:55:41.679 INFO:teuthology.orchestra.run.smithi175.stdout:(45/174): fuse-2.9.9-15.el9.x86_64.rpm 59 kB/s | 80 kB 00:01 2024-04-14T10:55:41.762 INFO:teuthology.orchestra.run.smithi175.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-04-14T10:55:41.793 INFO:teuthology.orchestra.run.smithi084.stdout:(56/174): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-04-14T10:55:41.829 INFO:teuthology.orchestra.run.smithi175.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-04-14T10:55:41.852 INFO:teuthology.orchestra.run.smithi084.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-14T10:55:41.854 INFO:teuthology.orchestra.run.smithi175.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-14T10:55:41.896 INFO:teuthology.orchestra.run.smithi175.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-14T10:55:41.938 INFO:teuthology.orchestra.run.smithi175.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-14T10:55:41.985 INFO:teuthology.orchestra.run.smithi084.stdout:(58/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-04-14T10:55:42.069 INFO:teuthology.orchestra.run.smithi084.stdout:(59/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 544 kB/s | 45 kB 00:00 2024-04-14T10:55:42.130 INFO:teuthology.orchestra.run.smithi175.stdout:(51/174): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-04-14T10:55:42.164 INFO:teuthology.orchestra.run.smithi175.stdout:(52/174): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-04-14T10:55:42.189 INFO:teuthology.orchestra.run.smithi175.stdout:(53/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-14T10:55:42.215 INFO:teuthology.orchestra.run.smithi175.stdout:(54/174): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-14T10:55:42.240 INFO:teuthology.orchestra.run.smithi175.stdout:(55/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-14T10:55:42.265 INFO:teuthology.orchestra.run.smithi175.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-04-14T10:55:42.323 INFO:teuthology.orchestra.run.smithi175.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-14T10:55:42.382 INFO:teuthology.orchestra.run.smithi175.stdout:(58/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-04-14T10:55:42.386 INFO:teuthology.orchestra.run.smithi084.stdout:(60/174): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-04-14T10:55:42.408 INFO:teuthology.orchestra.run.smithi175.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-04-14T10:55:42.433 INFO:teuthology.orchestra.run.smithi175.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-04-14T10:55:42.466 INFO:teuthology.orchestra.run.smithi175.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-14T10:55:42.500 INFO:teuthology.orchestra.run.smithi175.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-14T10:55:42.525 INFO:teuthology.orchestra.run.smithi175.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-04-14T10:55:42.551 INFO:teuthology.orchestra.run.smithi175.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-14T10:55:42.576 INFO:teuthology.orchestra.run.smithi175.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-04-14T10:55:42.601 INFO:teuthology.orchestra.run.smithi175.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-14T10:55:42.626 INFO:teuthology.orchestra.run.smithi175.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-04-14T10:55:42.669 INFO:teuthology.orchestra.run.smithi084.stdout:(61/174): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 582 kB 00:00 2024-04-14T10:55:42.735 INFO:teuthology.orchestra.run.smithi175.stdout:(68/174): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-04-14T10:55:42.736 INFO:teuthology.orchestra.run.smithi084.stdout:(62/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-04-14T10:55:42.787 INFO:teuthology.orchestra.run.smithi084.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 217 kB/s | 25 kB 00:00 2024-04-14T10:55:42.810 INFO:teuthology.orchestra.run.smithi175.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-04-14T10:55:42.812 INFO:teuthology.orchestra.run.smithi084.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-04-14T10:55:42.869 INFO:teuthology.orchestra.run.smithi175.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 17 MB/s | 4.1 MB 00:00 2024-04-14T10:55:42.904 INFO:teuthology.orchestra.run.smithi084.stdout:(65/174): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-14T10:55:42.911 INFO:teuthology.orchestra.run.smithi175.stdout:(71/174): postgresql-contrib-13.14-1.el9.x86_64 8.9 MB/s | 911 kB 00:00 2024-04-14T10:55:42.936 INFO:teuthology.orchestra.run.smithi175.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 1.9 MB/s | 133 kB 00:00 2024-04-14T10:55:42.946 INFO:teuthology.orchestra.run.smithi084.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-04-14T10:55:42.980 INFO:teuthology.orchestra.run.smithi084.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 469 kB/s | 35 kB 00:00 2024-04-14T10:55:43.037 INFO:teuthology.orchestra.run.smithi175.stdout:(73/174): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-14T10:55:43.079 INFO:teuthology.orchestra.run.smithi175.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 2.0 MB/s | 87 kB 00:00 2024-04-14T10:55:43.154 INFO:teuthology.orchestra.run.smithi175.stdout:(75/174): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-04-14T10:55:43.204 INFO:teuthology.orchestra.run.smithi175.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-04-14T10:55:43.296 INFO:teuthology.orchestra.run.smithi175.stdout:(77/174): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-04-14T10:55:43.321 INFO:teuthology.orchestra.run.smithi175.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-04-14T10:55:43.355 INFO:teuthology.orchestra.run.smithi175.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-04-14T10:55:43.381 INFO:teuthology.orchestra.run.smithi175.stdout:(80/174): python3-jsonpointer-2.0-4.el9.noarch. 325 kB/s | 19 kB 00:00 2024-04-14T10:55:43.406 INFO:teuthology.orchestra.run.smithi175.stdout:(81/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-14T10:55:43.431 INFO:teuthology.orchestra.run.smithi175.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-04-14T10:55:43.551 INFO:teuthology.orchestra.run.smithi175.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-04-14T10:55:43.693 INFO:teuthology.orchestra.run.smithi175.stdout:(84/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-04-14T10:55:43.724 INFO:teuthology.orchestra.run.smithi175.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-04-14T10:55:43.749 INFO:teuthology.orchestra.run.smithi175.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 77 kB 00:00 2024-04-14T10:55:43.783 INFO:teuthology.orchestra.run.smithi175.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-04-14T10:55:43.808 INFO:teuthology.orchestra.run.smithi175.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-04-14T10:55:43.834 INFO:teuthology.orchestra.run.smithi175.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-14T10:55:43.859 INFO:teuthology.orchestra.run.smithi175.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-04-14T10:55:43.884 INFO:teuthology.orchestra.run.smithi175.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-14T10:55:43.909 INFO:teuthology.orchestra.run.smithi175.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-14T10:55:43.946 INFO:teuthology.orchestra.run.smithi084.stdout:(68/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 4.3 MB/s | 4.1 MB 00:00 2024-04-14T10:55:43.984 INFO:teuthology.orchestra.run.smithi175.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 556 kB/s | 42 kB 00:00 2024-04-14T10:55:44.052 INFO:teuthology.orchestra.run.smithi175.stdout:(94/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-04-14T10:55:44.102 INFO:teuthology.orchestra.run.smithi175.stdout:(95/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-14T10:55:44.160 INFO:teuthology.orchestra.run.smithi175.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-04-14T10:55:44.319 INFO:teuthology.orchestra.run.smithi175.stdout:(97/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-04-14T10:55:44.344 INFO:teuthology.orchestra.run.smithi175.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 258 kB/s | 47 kB 00:00 2024-04-14T10:55:44.363 INFO:teuthology.orchestra.run.smithi084.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 3.8 MB/s | 1.6 MB 00:00 2024-04-14T10:55:44.369 INFO:teuthology.orchestra.run.smithi175.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-04-14T10:55:44.395 INFO:teuthology.orchestra.run.smithi175.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-14T10:55:44.420 INFO:teuthology.orchestra.run.smithi175.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-04-14T10:55:44.430 INFO:teuthology.orchestra.run.smithi084.stdout:(70/174): openblas-openmp-0.3.21-2.el9.x86_64.r 3.2 MB/s | 4.7 MB 00:01 2024-04-14T10:55:44.445 INFO:teuthology.orchestra.run.smithi175.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-14T10:55:44.471 INFO:teuthology.orchestra.run.smithi175.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-04-14T10:55:44.506 INFO:teuthology.orchestra.run.smithi084.stdout:(71/174): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-14T10:55:44.596 INFO:teuthology.orchestra.run.smithi175.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-04-14T10:55:44.658 INFO:teuthology.orchestra.run.smithi084.stdout:(72/174): postgresql-contrib-13.14-1.el9.x86_64 3.0 MB/s | 911 kB 00:00 2024-04-14T10:55:44.906 INFO:teuthology.orchestra.run.smithi084.stdout:(73/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-04-14T10:55:44.973 INFO:teuthology.orchestra.run.smithi084.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-04-14T10:55:45.004 INFO:teuthology.orchestra.run.smithi175.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-04-14T10:55:45.030 INFO:teuthology.orchestra.run.smithi175.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-14T10:55:45.097 INFO:teuthology.orchestra.run.smithi175.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-04-14T10:55:45.114 INFO:teuthology.orchestra.run.smithi175.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 232 kB/s | 19 kB 00:00 2024-04-14T10:55:45.306 INFO:teuthology.orchestra.run.smithi175.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 135 kB/s | 26 kB 00:00 2024-04-14T10:55:45.373 INFO:teuthology.orchestra.run.smithi175.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-04-14T10:55:45.389 INFO:teuthology.orchestra.run.smithi175.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 596 kB/s | 49 kB 00:00 2024-04-14T10:55:45.440 INFO:teuthology.orchestra.run.smithi175.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-14T10:55:45.448 INFO:teuthology.orchestra.run.smithi084.stdout:(75/174): postgresql-server-13.14-1.el9.x86_64. 6.1 MB/s | 5.8 MB 00:00 2024-04-14T10:55:45.457 INFO:teuthology.orchestra.run.smithi175.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-04-14T10:55:45.524 INFO:teuthology.orchestra.run.smithi084.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-04-14T10:55:45.566 INFO:teuthology.orchestra.run.smithi175.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.6 MB/s | 838 kB 00:00 2024-04-14T10:55:45.591 INFO:teuthology.orchestra.run.smithi175.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-04-14T10:55:45.607 INFO:teuthology.orchestra.run.smithi084.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-14T10:55:45.657 INFO:teuthology.orchestra.run.smithi084.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-04-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi175.stdout:(116/174): ceph-radosgw-19.0.0-2765.g605eb165.e 1.0 MB/s | 10 MB 00:10 2024-04-14T10:55:45.708 INFO:teuthology.orchestra.run.smithi084.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-04-14T10:55:45.733 INFO:teuthology.orchestra.run.smithi175.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 261 kB/s | 43 kB 00:00 2024-04-14T10:55:45.758 INFO:teuthology.orchestra.run.smithi175.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 193 kB/s | 32 kB 00:00 2024-04-14T10:55:45.784 INFO:teuthology.orchestra.run.smithi175.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-14T10:55:45.791 INFO:teuthology.orchestra.run.smithi084.stdout:(80/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-14T10:55:45.834 INFO:teuthology.orchestra.run.smithi175.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-14T10:55:45.842 INFO:teuthology.orchestra.run.smithi084.stdout:(81/174): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-04-14T10:55:45.859 INFO:teuthology.orchestra.run.smithi175.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-04-14T10:55:45.884 INFO:teuthology.orchestra.run.smithi175.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-14T10:55:45.910 INFO:teuthology.orchestra.run.smithi175.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 471 kB/s | 35 kB 00:00 2024-04-14T10:55:45.935 INFO:teuthology.orchestra.run.smithi175.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-04-14T10:55:46.068 INFO:teuthology.orchestra.run.smithi175.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-04-14T10:55:46.092 INFO:teuthology.orchestra.run.smithi084.stdout:(82/174): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-04-14T10:55:46.094 INFO:teuthology.orchestra.run.smithi175.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 787 kB/s | 144 kB 00:00 2024-04-14T10:55:46.119 INFO:teuthology.orchestra.run.smithi175.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 58 kB/s | 11 kB 00:00 2024-04-14T10:55:46.144 INFO:teuthology.orchestra.run.smithi175.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-14T10:55:46.176 INFO:teuthology.orchestra.run.smithi084.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-14T10:55:46.186 INFO:teuthology.orchestra.run.smithi175.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 347 kB/s | 23 kB 00:00 2024-04-14T10:55:46.211 INFO:teuthology.orchestra.run.smithi175.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-14T10:55:46.237 INFO:teuthology.orchestra.run.smithi175.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-04-14T10:55:46.259 INFO:teuthology.orchestra.run.smithi084.stdout:(84/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-14T10:55:46.278 INFO:teuthology.orchestra.run.smithi175.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-04-14T10:55:46.304 INFO:teuthology.orchestra.run.smithi175.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-04-14T10:55:46.318 INFO:teuthology.orchestra.run.smithi084.stdout:(85/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-14T10:55:46.329 INFO:teuthology.orchestra.run.smithi175.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 867 kB/s | 79 kB 00:00 2024-04-14T10:55:46.354 INFO:teuthology.orchestra.run.smithi175.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 764 kB/s | 58 kB 00:00 2024-04-14T10:55:46.376 INFO:teuthology.orchestra.run.smithi084.stdout:(86/174): python3-prettytable-0.7.2-27.el9.noar 726 kB/s | 42 kB 00:00 2024-04-14T10:55:46.380 INFO:teuthology.orchestra.run.smithi175.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-14T10:55:46.405 INFO:teuthology.orchestra.run.smithi175.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-14T10:55:46.431 INFO:teuthology.orchestra.run.smithi175.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-14T10:55:46.456 INFO:teuthology.orchestra.run.smithi175.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-14T10:55:46.468 INFO:teuthology.orchestra.run.smithi084.stdout:(87/174): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-04-14T10:55:46.481 INFO:teuthology.orchestra.run.smithi175.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-14T10:55:46.506 INFO:teuthology.orchestra.run.smithi175.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-14T10:55:46.531 INFO:teuthology.orchestra.run.smithi175.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-04-14T10:55:46.557 INFO:teuthology.orchestra.run.smithi175.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2024-04-14T10:55:46.582 INFO:teuthology.orchestra.run.smithi175.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-04-14T10:55:46.594 INFO:teuthology.orchestra.run.smithi084.stdout:(88/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.8 MB/s | 5.1 MB 00:00 2024-04-14T10:55:46.608 INFO:teuthology.orchestra.run.smithi175.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-14T10:55:46.619 INFO:teuthology.orchestra.run.smithi084.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-14T10:55:46.633 INFO:teuthology.orchestra.run.smithi175.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-14T10:55:46.658 INFO:teuthology.orchestra.run.smithi175.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-14T10:55:46.675 INFO:teuthology.orchestra.run.smithi175.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-04-14T10:55:46.678 INFO:teuthology.orchestra.run.smithi084.stdout:(90/174): python3-pytz-2021.1-5.el9.noarch.rpm 880 kB/s | 51 kB 00:00 2024-04-14T10:55:46.700 INFO:teuthology.orchestra.run.smithi175.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-04-14T10:55:46.703 INFO:teuthology.orchestra.run.smithi084.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-14T10:55:46.745 INFO:teuthology.orchestra.run.smithi084.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 801 kB/s | 54 kB 00:00 2024-04-14T10:55:46.759 INFO:teuthology.orchestra.run.smithi175.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-04-14T10:55:46.804 INFO:teuthology.orchestra.run.smithi084.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 716 kB/s | 42 kB 00:00 2024-04-14T10:55:46.863 INFO:teuthology.orchestra.run.smithi084.stdout:(94/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-04-14T10:55:46.946 INFO:teuthology.orchestra.run.smithi084.stdout:(95/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-14T10:55:46.976 INFO:teuthology.orchestra.run.smithi175.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-04-14T10:55:47.013 INFO:teuthology.orchestra.run.smithi084.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-04-14T10:55:47.051 INFO:teuthology.orchestra.run.smithi175.stdout:(152/174): librbd1-19.0.0-2765.g605eb165.el9.x8 9.0 MB/s | 3.1 MB 00:00 2024-04-14T10:55:47.080 INFO:teuthology.orchestra.run.smithi084.stdout:(97/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 713 kB/s | 47 kB 00:00 2024-04-14T10:55:47.101 INFO:teuthology.orchestra.run.smithi175.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 15 MB/s | 1.8 MB 00:00 2024-04-14T10:55:47.136 INFO:teuthology.orchestra.run.smithi175.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 501 kB/s | 42 kB 00:00 2024-04-14T10:55:47.163 INFO:teuthology.orchestra.run.smithi084.stdout:(98/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-14T10:55:47.168 INFO:teuthology.orchestra.run.smithi175.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-04-14T10:55:47.222 INFO:teuthology.orchestra.run.smithi084.stdout:(99/174): uuid-1.6.2-55.el9.x86_64.rpm 995 kB/s | 58 kB 00:00 2024-04-14T10:55:47.227 INFO:teuthology.orchestra.run.smithi175.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 776 kB/s | 71 kB 00:00 2024-04-14T10:55:47.281 INFO:teuthology.orchestra.run.smithi084.stdout:(100/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-04-14T10:55:47.319 INFO:teuthology.orchestra.run.smithi175.stdout:(157/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-04-14T10:55:47.344 INFO:teuthology.orchestra.run.smithi175.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 207 kB/s | 36 kB 00:00 2024-04-14T10:55:47.348 INFO:teuthology.orchestra.run.smithi084.stdout:(101/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-04-14T10:55:47.395 INFO:teuthology.orchestra.run.smithi175.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-04-14T10:55:47.406 INFO:teuthology.orchestra.run.smithi084.stdout:(102/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-04-14T10:55:47.420 INFO:teuthology.orchestra.run.smithi175.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 306 kB/s | 23 kB 00:00 2024-04-14T10:55:47.462 INFO:teuthology.orchestra.run.smithi175.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-04-14T10:55:47.520 INFO:teuthology.orchestra.run.smithi175.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.5 MB/s | 155 kB 00:00 2024-04-14T10:55:47.531 INFO:teuthology.orchestra.run.smithi084.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-04-14T10:55:47.546 INFO:teuthology.orchestra.run.smithi175.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-04-14T10:55:47.588 INFO:teuthology.orchestra.run.smithi175.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 953 kB/s | 64 kB 00:00 2024-04-14T10:55:47.613 INFO:teuthology.orchestra.run.smithi175.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 428 kB/s | 29 kB 00:00 2024-04-14T10:55:47.689 INFO:teuthology.orchestra.run.smithi175.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-04-14T10:55:47.764 INFO:teuthology.orchestra.run.smithi175.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-04-14T10:55:47.822 INFO:teuthology.orchestra.run.smithi175.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 17 MB/s | 2.3 MB 00:00 2024-04-14T10:55:47.873 INFO:teuthology.orchestra.run.smithi175.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-04-14T10:55:47.898 INFO:teuthology.orchestra.run.smithi175.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 414 kB/s | 31 kB 00:00 2024-04-14T10:55:47.948 INFO:teuthology.orchestra.run.smithi175.stdout:(171/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2024-04-14T10:55:47.991 INFO:teuthology.orchestra.run.smithi175.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-14T10:55:48.015 INFO:teuthology.orchestra.run.smithi175.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 74 kB 00:00 2024-04-14T10:55:48.024 INFO:teuthology.orchestra.run.smithi084.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-04-14T10:55:48.274 INFO:teuthology.orchestra.run.smithi084.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-14T10:55:48.358 INFO:teuthology.orchestra.run.smithi084.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 3.6 MB/s | 309 kB 00:00 2024-04-14T10:55:48.400 INFO:teuthology.orchestra.run.smithi084.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 468 kB/s | 19 kB 00:00 2024-04-14T10:55:48.416 INFO:teuthology.orchestra.run.smithi175.stdout:(174/174): librados2-19.0.0-2765.g605eb165.el9. 2.0 MB/s | 3.4 MB 00:01 2024-04-14T10:55:48.422 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:55:48.422 INFO:teuthology.orchestra.run.smithi175.stdout:Total 13 MB/s | 229 MB 00:17 2024-04-14T10:55:48.550 INFO:teuthology.orchestra.run.smithi084.stdout:(108/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.8 MB/s | 16 MB 00:01 2024-04-14T10:55:48.692 INFO:teuthology.orchestra.run.smithi084.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 184 kB/s | 26 kB 00:00 2024-04-14T10:55:48.751 INFO:teuthology.orchestra.run.smithi084.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 835 kB/s | 49 kB 00:00 2024-04-14T10:55:48.809 INFO:teuthology.orchestra.run.smithi084.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-14T10:55:48.868 INFO:teuthology.orchestra.run.smithi084.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-04-14T10:55:49.026 INFO:teuthology.orchestra.run.smithi084.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-04-14T10:55:49.152 INFO:teuthology.orchestra.run.smithi084.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-14T10:55:49.194 INFO:teuthology.orchestra.run.smithi084.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-04-14T10:55:49.303 INFO:teuthology.orchestra.run.smithi084.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-04-14T10:55:49.370 INFO:teuthology.orchestra.run.smithi084.stdout:(117/174): libarrow-9.0.0-10.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-04-14T10:55:49.403 INFO:teuthology.orchestra.run.smithi084.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-04-14T10:55:49.445 INFO:teuthology.orchestra.run.smithi084.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-14T10:55:49.562 INFO:teuthology.orchestra.run.smithi084.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-14T10:55:49.604 INFO:teuthology.orchestra.run.smithi084.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 851 kB/s | 35 kB 00:00 2024-04-14T10:55:49.646 INFO:teuthology.orchestra.run.smithi084.stdout:(122/174): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-04-14T10:55:49.730 INFO:teuthology.orchestra.run.smithi084.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 1.6 MB/s | 203 kB 00:00 2024-04-14T10:55:49.737 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-14T10:55:49.822 INFO:teuthology.orchestra.run.smithi084.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-14T10:55:49.880 INFO:teuthology.orchestra.run.smithi084.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 184 kB/s | 11 kB 00:00 2024-04-14T10:55:49.914 INFO:teuthology.orchestra.run.smithi084.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 534 kB/s | 18 kB 00:00 2024-04-14T10:55:49.947 INFO:teuthology.orchestra.run.smithi084.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 698 kB/s | 23 kB 00:00 2024-04-14T10:55:49.981 INFO:teuthology.orchestra.run.smithi084.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 584 kB/s | 19 kB 00:00 2024-04-14T10:55:50.014 INFO:teuthology.orchestra.run.smithi084.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 595 kB/s | 20 kB 00:00 2024-04-14T10:55:50.020 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-14T10:55:50.020 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-14T10:55:50.315 INFO:teuthology.orchestra.run.smithi084.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-04-14T10:55:50.357 INFO:teuthology.orchestra.run.smithi084.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-04-14T10:55:50.415 INFO:teuthology.orchestra.run.smithi084.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-14T10:55:50.457 INFO:teuthology.orchestra.run.smithi084.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-04-14T10:55:50.558 INFO:teuthology.orchestra.run.smithi084.stdout:(134/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-04-14T10:55:50.600 INFO:teuthology.orchestra.run.smithi084.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 395 kB/s | 16 kB 00:00 2024-04-14T10:55:50.658 INFO:teuthology.orchestra.run.smithi084.stdout:(136/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-04-14T10:55:50.700 INFO:teuthology.orchestra.run.smithi084.stdout:(137/174): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-04-14T10:55:50.742 INFO:teuthology.orchestra.run.smithi084.stdout:(138/174): python3-repoze-lru-0.7-16.el9.noarch 742 kB/s | 31 kB 00:00 2024-04-14T10:55:50.818 INFO:teuthology.orchestra.run.smithi084.stdout:(139/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-14T10:55:50.859 INFO:teuthology.orchestra.run.smithi084.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-04-14T10:55:50.901 INFO:teuthology.orchestra.run.smithi084.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 860 kB/s | 36 kB 00:00 2024-04-14T10:55:50.944 INFO:teuthology.orchestra.run.smithi084.stdout:(142/174): python3-typing-extensions-4.4.0-2.el 1.2 MB/s | 51 kB 00:00 2024-04-14T10:55:51.003 INFO:teuthology.orchestra.run.smithi084.stdout:(143/174): python3-grpcio-1.46.7-10.el9.x86_64. 1.5 MB/s | 2.0 MB 00:01 2024-04-14T10:55:51.078 INFO:teuthology.orchestra.run.smithi084.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-04-14T10:55:51.103 INFO:teuthology.orchestra.run.smithi084.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 896 kB/s | 90 kB 00:00 2024-04-14T10:55:51.145 INFO:teuthology.orchestra.run.smithi084.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-04-14T10:55:51.237 INFO:teuthology.orchestra.run.smithi084.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-04-14T10:55:51.278 INFO:teuthology.orchestra.run.smithi084.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-14T10:55:51.663 INFO:teuthology.orchestra.run.smithi084.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-04-14T10:55:52.169 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-14T10:55:52.169 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-14T10:55:52.213 INFO:teuthology.orchestra.run.smithi084.stdout:(150/174): ceph-test-19.0.0-2765.g605eb165.el9. 2.4 MB/s | 49 MB 00:20 2024-04-14T10:55:52.521 INFO:teuthology.orchestra.run.smithi084.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 7.5 MB/s | 2.3 MB 00:00 2024-04-14T10:55:52.705 INFO:teuthology.orchestra.run.smithi084.stdout:(152/174): librbd1-19.0.0-2765.g605eb165.el9.x8 3.0 MB/s | 3.1 MB 00:01 2024-04-14T10:55:52.772 INFO:teuthology.orchestra.run.smithi084.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 7.3 MB/s | 1.8 MB 00:00 2024-04-14T10:55:52.880 INFO:teuthology.orchestra.run.smithi084.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 240 kB/s | 42 kB 00:00 2024-04-14T10:55:52.964 INFO:teuthology.orchestra.run.smithi084.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 1.3 MB/s | 249 kB 00:00 2024-04-14T10:55:52.989 INFO:teuthology.orchestra.run.smithi084.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 658 kB/s | 71 kB 00:00 2024-04-14T10:55:53.014 INFO:teuthology.orchestra.run.smithi084.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 724 kB/s | 36 kB 00:00 2024-04-14T10:55:53.081 INFO:teuthology.orchestra.run.smithi084.stdout:(158/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 256 kB 00:00 2024-04-14T10:55:53.104 INFO:teuthology.orchestra.run.smithi084.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-04-14T10:55:53.137 INFO:teuthology.orchestra.run.smithi084.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 413 kB/s | 23 kB 00:00 2024-04-14T10:55:53.163 INFO:teuthology.orchestra.run.smithi084.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-04-14T10:55:53.213 INFO:teuthology.orchestra.run.smithi084.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-04-14T10:55:53.239 INFO:teuthology.orchestra.run.smithi084.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 1.7 MB/s | 136 kB 00:00 2024-04-14T10:55:53.273 INFO:teuthology.orchestra.run.smithi084.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-04-14T10:55:53.298 INFO:teuthology.orchestra.run.smithi084.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 490 kB/s | 29 kB 00:00 2024-04-14T10:55:53.373 INFO:teuthology.orchestra.run.smithi084.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-04-14T10:55:53.540 INFO:teuthology.orchestra.run.smithi084.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 8.9 MB/s | 2.2 MB 00:00 2024-04-14T10:55:53.590 INFO:teuthology.orchestra.run.smithi084.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-14T10:55:53.624 INFO:teuthology.orchestra.run.smithi084.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.5 MB/s | 465 kB 00:00 2024-04-14T10:55:53.641 INFO:teuthology.orchestra.run.smithi084.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 620 kB/s | 31 kB 00:00 2024-04-14T10:55:53.683 INFO:teuthology.orchestra.run.smithi084.stdout:(171/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-14T10:55:53.741 INFO:teuthology.orchestra.run.smithi084.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-04-14T10:55:53.908 INFO:teuthology.orchestra.run.smithi084.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 330 kB/s | 74 kB 00:00 2024-04-14T10:55:58.233 INFO:teuthology.orchestra.run.smithi084.stdout:(174/174): librados2-19.0.0-2765.g605eb165.el9. 500 kB/s | 3.4 MB 00:06 2024-04-14T10:55:58.240 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:55:58.240 INFO:teuthology.orchestra.run.smithi084.stdout:Total 7.3 MB/s | 229 MB 00:31 2024-04-14T10:55:59.290 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-14T10:55:59.428 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T10:55:59.463 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T10:55:59.501 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:55:59.510 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:55:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T10:55:59.621 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T10:55:59.628 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-14T10:55:59.654 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T10:55:59.697 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T10:55:59.750 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T10:55:59.916 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-14T10:55:59.916 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-14T10:56:00.090 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T10:56:00.149 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-2765.g605eb165.el9.x86_64 10/198 2024-04-14T10:56:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-2765.g605eb165.el9.x86_64 10/198 2024-04-14T10:56:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 11/198 2024-04-14T10:56:00.373 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 11/198 2024-04-14T10:56:00.405 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-2765.g605eb165.el9.x86_64 12/198 2024-04-14T10:56:00.443 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T10:56:00.627 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T10:56:00.685 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T10:56:00.713 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 16/198 2024-04-14T10:56:00.815 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 16/198 2024-04-14T10:56:00.839 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86 17/198 2024-04-14T10:56:00.904 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86 17/198 2024-04-14T10:56:00.943 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T10:56:00.966 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:56:00.982 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:56:01.166 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:56:01.207 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:56:01.246 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T10:56:01.461 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T10:56:01.593 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:56:01.636 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:56:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:56:01.779 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:56:01.991 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:56:02.106 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T10:56:02.121 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-14T10:56:02.122 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-14T10:56:02.203 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T10:56:02.243 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T10:56:02.277 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T10:56:02.341 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T10:56:02.377 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T10:56:02.420 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T10:56:02.453 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T10:56:02.481 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T10:56:02.548 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T10:56:02.602 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T10:56:02.637 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T10:56:02.677 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T10:56:02.752 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T10:56:02.788 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-2765.g605eb165.el9. 39/198 2024-04-14T10:56:02.831 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-2765.g605eb165.el 40/198 2024-04-14T10:56:02.860 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-2765.g605eb165.el9.x86_6 41/198 2024-04-14T10:56:02.928 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T10:56:02.975 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T10:56:03.048 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T10:56:03.181 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T10:56:03.244 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T10:56:03.762 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T10:56:03.839 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T10:56:03.924 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T10:56:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:56:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:56:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T10:56:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T10:56:04.111 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-2765.g605eb165.el9.x86_6 53/198 2024-04-14T10:56:04.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T10:56:04.419 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T10:56:04.588 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T10:56:04.679 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T10:56:04.723 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T10:56:04.872 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T10:56:04.942 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T10:56:04.996 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T10:56:05.238 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T10:56:05.268 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T10:56:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T10:56:05.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T10:56:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T10:56:05.430 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T10:56:05.480 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T10:56:05.613 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T10:56:05.652 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T10:56:05.683 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T10:56:05.724 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T10:56:05.817 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T10:56:05.857 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T10:56:05.898 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T10:56:05.923 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T10:56:05.948 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T10:56:06.026 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T10:56:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T10:56:06.189 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T10:56:06.257 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T10:56:06.257 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T10:56:06.290 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T10:56:06.321 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T10:56:06.351 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T10:56:06.402 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T10:56:06.435 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T10:56:06.477 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T10:56:06.514 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T10:56:06.606 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T10:56:06.650 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T10:56:06.681 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T10:56:06.728 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T10:56:06.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T10:56:06.882 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T10:56:07.602 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T10:56:07.646 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T10:56:07.690 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T10:56:07.785 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T10:56:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T10:56:07.931 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T10:56:07.973 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T10:56:08.150 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T10:56:08.179 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T10:56:08.257 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T10:56:08.890 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T10:56:09.001 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T10:56:09.140 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-14T10:56:09.267 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T10:56:09.313 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T10:56:09.351 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:56:09.362 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:56:09.416 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T10:56:09.481 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T10:56:09.513 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T10:56:09.547 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T10:56:09.599 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T10:56:09.926 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T10:56:09.990 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.0.0-2765.g605eb165.el9.x86_64 10/198 2024-04-14T10:56:10.102 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.0.0-2765.g605eb165.el9.x86_64 10/198 2024-04-14T10:56:10.135 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 11/198 2024-04-14T10:56:10.213 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T10:56:10.247 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 11/198 2024-04-14T10:56:10.282 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.0.0-2765.g605eb165.el9.x86_64 12/198 2024-04-14T10:56:10.306 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T10:56:10.324 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T10:56:10.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T10:56:10.525 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T10:56:10.588 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T10:56:10.625 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 16/198 2024-04-14T10:56:10.643 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T10:56:10.671 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 112/198 2024-04-14T10:56:10.711 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 16/198 2024-04-14T10:56:10.741 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86 17/198 2024-04-14T10:56:10.761 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 112/198 2024-04-14T10:56:10.792 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-2765.g605eb165.el9.x86_64 113/198 2024-04-14T10:56:10.806 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86 17/198 2024-04-14T10:56:10.830 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T10:56:10.854 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T10:56:10.876 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:56:10.893 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:56:11.086 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:56:11.125 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:56:11.164 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T10:56:11.297 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:56:11.332 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 116/198 2024-04-14T10:56:11.392 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T10:56:11.392 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 116/198 2024-04-14T10:56:11.408 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-2765.g605eb165.el9.x86_64 117/198 2024-04-14T10:56:11.466 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:56:11.526 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:56:11.620 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:56:11.677 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:56:11.882 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:56:11.998 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T10:56:12.093 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T10:56:12.140 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T10:56:12.174 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T10:56:12.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T10:56:12.282 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T10:56:12.326 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T10:56:12.368 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T10:56:12.403 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T10:56:12.471 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T10:56:12.536 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T10:56:12.565 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T10:56:12.607 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T10:56:12.683 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T10:56:12.718 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.0.0-2765.g605eb165.el9. 39/198 2024-04-14T10:56:12.763 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.0.0-2765.g605eb165.el 40/198 2024-04-14T10:56:12.799 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.0.0-2765.g605eb165.el9.x86_6 41/198 2024-04-14T10:56:12.875 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T10:56:12.930 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T10:56:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T10:56:13.167 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T10:56:13.224 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T10:56:13.643 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 118/198 2024-04-14T10:56:13.672 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 118/198 2024-04-14T10:56:13.740 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T10:56:13.819 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T10:56:13.908 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T10:56:13.956 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:56:13.965 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:56:14.017 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T10:56:14.071 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T10:56:14.108 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.0.0-2765.g605eb165.el9.x86_6 53/198 2024-04-14T10:56:14.138 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T10:56:14.210 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 118/198 2024-04-14T10:56:14.249 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 119/198 2024-04-14T10:56:14.325 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 119/198 2024-04-14T10:56:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T10:56:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T10:56:14.325 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 120/198 2024-04-14T10:56:14.452 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T10:56:14.634 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T10:56:14.722 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T10:56:14.775 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T10:56:14.919 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T10:56:14.969 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T10:56:15.024 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T10:56:15.098 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T10:56:15.128 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T10:56:15.165 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T10:56:15.211 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T10:56:15.256 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T10:56:15.307 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T10:56:15.349 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T10:56:15.484 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T10:56:15.529 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T10:56:15.560 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T10:56:15.601 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T10:56:15.697 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T10:56:15.751 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T10:56:15.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T10:56:15.834 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T10:56:15.859 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T10:56:15.938 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T10:56:16.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T10:56:16.132 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T10:56:16.160 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T10:56:16.194 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T10:56:16.233 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T10:56:16.265 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T10:56:16.295 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T10:56:16.338 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T10:56:16.380 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T10:56:16.421 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T10:56:16.456 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T10:56:16.542 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T10:56:16.585 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T10:56:16.617 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T10:56:16.664 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T10:56:16.770 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T10:56:16.826 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T10:56:17.574 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T10:56:17.630 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T10:56:17.672 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T10:56:17.781 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T10:56:17.838 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T10:56:17.925 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T10:56:17.974 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T10:56:18.152 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T10:56:18.180 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T10:56:18.269 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T10:56:18.912 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T10:56:19.019 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T10:56:20.269 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T10:56:20.349 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T10:56:20.376 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T10:56:20.687 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T10:56:20.714 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 112/198 2024-04-14T10:56:20.804 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 112/198 2024-04-14T10:56:20.836 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.0.0-2765.g605eb165.el9.x86_64 113/198 2024-04-14T10:56:20.872 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T10:56:21.346 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:56:21.384 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 116/198 2024-04-14T10:56:21.455 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 116/198 2024-04-14T10:56:21.477 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.0.0-2765.g605eb165.el9.x86_64 117/198 2024-04-14T10:56:23.683 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 118/198 2024-04-14T10:56:23.732 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 118/198 2024-04-14T10:56:24.268 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 118/198 2024-04-14T10:56:24.310 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 119/198 2024-04-14T10:56:24.400 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 119/198 2024-04-14T10:56:24.400 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T10:56:24.401 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T10:56:24.401 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:24.444 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 120/198 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 120/198 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-04-14T10:56:25.976 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:26.144 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 121/198 2024-04-14T10:56:26.159 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 121/198 2024-04-14T10:56:26.159 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:26.159 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T10:56:26.160 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:27.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 122/198 2024-04-14T10:56:27.647 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 122/198 2024-04-14T10:56:27.648 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:27.648 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T10:56:27.648 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:56:27.648 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:56:27.648 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:27.873 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 123/198 2024-04-14T10:56:27.895 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 123/198 2024-04-14T10:56:27.895 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:27.896 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T10:56:27.896 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:56:27.896 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:56:27.896 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:28.340 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 124/198 2024-04-14T10:56:28.362 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 124/198 2024-04-14T10:56:28.363 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:28.363 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T10:56:28.363 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:56:28.363 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:56:28.363 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:28.478 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T10:56:28.526 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T10:56:28.581 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T10:56:28.766 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T10:56:28.815 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T10:56:28.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T10:56:28.972 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T10:56:29.103 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T10:56:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T10:56:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T10:56:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T10:56:29.240 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T10:56:29.276 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T10:56:29.703 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-2765.g605eb165.el9.noarch 138/198 2024-04-14T10:56:29.732 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-2765.g605eb165.el9.noarch 138/198 2024-04-14T10:56:29.765 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2765.g605eb165.e 139/198 2024-04-14T10:56:29.826 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2765.g605eb165. 140/198 2024-04-14T10:56:29.858 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noa 141/198 2024-04-14T10:56:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noa 141/198 2024-04-14T10:56:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.n 142/198 2024-04-14T10:56:31.892 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.n 142/198 2024-04-14T10:56:31.924 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2765.g605 143/198 2024-04-14T10:56:32.024 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2765.g605 143/198 2024-04-14T10:56:32.186 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2765.g605eb165.el 144/198 2024-04-14T10:56:32.218 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 145/198 2024-04-14T10:56:32.241 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 145/198 2024-04-14T10:56:32.241 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:32.241 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T10:56:32.241 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:56:32.241 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:56:32.241 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:32.285 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 146/198 2024-04-14T10:56:32.296 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 146/198 2024-04-14T10:56:32.393 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-2765.g605eb165.el9.x86_64 147/198 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 120/198 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-04-14T10:56:35.850 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:36.030 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 121/198 2024-04-14T10:56:36.045 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 121/198 2024-04-14T10:56:36.046 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:36.046 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T10:56:36.046 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:36.903 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 148/198 2024-04-14T10:56:36.974 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-2765.g605eb165.el9.x86_64 149/198 2024-04-14T10:56:37.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 122/198 2024-04-14T10:56:37.557 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 122/198 2024-04-14T10:56:37.557 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:37.557 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T10:56:37.557 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:56:37.558 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:56:37.558 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:37.790 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 123/198 2024-04-14T10:56:37.813 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 123/198 2024-04-14T10:56:37.813 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:37.813 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T10:56:37.813 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:56:37.813 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:56:37.813 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:37.857 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T10:56:37.892 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 151/198 2024-04-14T10:56:37.915 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 151/198 2024-04-14T10:56:37.915 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:37.915 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T10:56:37.915 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:56:37.916 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:56:37.916 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:37.959 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2765.g605eb 152/198 2024-04-14T10:56:37.981 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2765.g605eb 152/198 2024-04-14T10:56:37.981 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:37.981 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T10:56:37.981 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:38.026 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 153/198 2024-04-14T10:56:38.049 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 153/198 2024-04-14T10:56:38.049 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:38.049 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T10:56:38.049 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:56:38.049 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:56:38.049 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:38.258 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 124/198 2024-04-14T10:56:38.280 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 124/198 2024-04-14T10:56:38.280 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:38.280 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T10:56:38.280 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:56:38.280 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:56:38.281 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 154/198 2024-04-14T10:56:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 154/198 2024-04-14T10:56:38.375 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:38.375 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T10:56:38.375 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:56:38.375 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:56:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:38.395 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T10:56:38.427 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 155/198 2024-04-14T10:56:38.443 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T10:56:38.457 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-2765.g605eb165.el9.x86_64 156/198 2024-04-14T10:56:38.484 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T10:56:38.499 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T10:56:38.681 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T10:56:38.687 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-2765.g605eb165.el9.x86_64 158/198 2024-04-14T10:56:38.724 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T10:56:38.740 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T10:56:38.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T10:56:38.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T10:56:38.857 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T10:56:38.890 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T10:56:38.900 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T10:56:38.932 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-2765.g605eb165.el9.x86_ 163/198 2024-04-14T10:56:38.965 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T10:56:38.994 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T10:56:39.028 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T10:56:39.051 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T10:56:39.069 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T10:56:39.107 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T10:56:39.115 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T10:56:39.138 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T10:56:39.159 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T10:56:39.174 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T10:56:39.202 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T10:56:39.669 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.0.0-2765.g605eb165.el9.noarch 138/198 2024-04-14T10:56:39.700 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.0.0-2765.g605eb165.el9.noarch 138/198 2024-04-14T10:56:39.732 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2765.g605eb165.e 139/198 2024-04-14T10:56:39.771 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:56:39.793 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2765.g605eb165. 140/198 2024-04-14T10:56:39.807 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:56:39.823 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noa 141/198 2024-04-14T10:56:39.827 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:56:40.642 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-2765.g605eb165.el9.noarch 170/198 2024-04-14T10:56:40.743 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T10:56:40.833 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T10:56:40.858 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noa 141/198 2024-04-14T10:56:40.863 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T10:56:40.888 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T10:56:40.900 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.n 142/198 2024-04-14T10:56:40.913 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T10:56:40.939 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T10:56:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T10:56:40.974 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:56:41.070 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:56:41.099 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T10:56:41.099 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:56:41.184 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:56:41.210 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T10:56:41.244 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T10:56:41.277 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T10:56:41.310 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T10:56:41.345 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T10:56:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T10:56:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T10:56:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:56:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T10:56:41.500 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:56:41.533 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T10:56:41.539 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:56:41.539 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:56:41.730 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:56:41.730 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:56:41.810 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:56:41.835 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T10:56:41.856 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.n 142/198 2024-04-14T10:56:41.883 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2765.g605 143/198 2024-04-14T10:56:41.918 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T10:56:41.945 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T10:56:41.970 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T10:56:41.984 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2765.g605 143/198 2024-04-14T10:56:42.035 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:56:42.145 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2765.g605eb165.el 144/198 2024-04-14T10:56:42.185 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 145/198 2024-04-14T10:56:42.208 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 145/198 2024-04-14T10:56:42.209 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:42.209 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T10:56:42.209 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:56:42.209 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:56:42.209 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:42.253 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 146/198 2024-04-14T10:56:42.264 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 146/198 2024-04-14T10:56:42.361 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.0.0-2765.g605eb165.el9.x86_64 147/198 2024-04-14T10:56:46.897 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 148/198 2024-04-14T10:56:46.957 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.0.0-2765.g605eb165.el9.x86_64 149/198 2024-04-14T10:56:47.692 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:56:47.692 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-2765.g605eb165.el9.x86_64 1/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 2/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 3/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 4/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2765.g605eb 5/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 6/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 7/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 8/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 9/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 10/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 11/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-2765.g605eb165.el9.x86_64 12/198 2024-04-14T10:56:47.693 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 13/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-2765.g605eb165.el9.x86_64 14/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-2765.g605eb165.el9.x86_ 15/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 16/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 17/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-2765.g605eb165.el9.x86_6 18/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86 19/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 20/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2765.g605eb165.el 21/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-2765.g605eb165.el9. 22/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-2765.g605eb165.el9.x86_6 23/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-2765.g605eb165.el9.x86_64 24/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-2765.g605eb165.el9.x86_64 25/198 2024-04-14T10:56:47.694 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-2765.g605eb165.el9.x86_64 26/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 27/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 28/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-2765.g605eb165.el9.x86_64 29/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2765.g605eb165. 30/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noa 31/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.n 32/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2765.g605 33/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2765.g605eb165.el 34/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 35/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2765.g605eb165.e 36/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 37/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-2765.g605eb165.el9.noarch 38/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-2765.g605eb165.el9.noarch 39/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T10:56:47.695 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T10:56:47.696 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T10:56:47.697 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T10:56:47.698 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T10:56:47.699 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T10:56:47.700 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T10:56:47.701 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T10:56:47.702 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T10:56:47.703 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-2765.g605eb165.el9.x86_64 151/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 153/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T10:56:47.704 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T10:56:47.705 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:56:47.706 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T10:56:47.707 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T10:56:47.835 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T10:56:47.867 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 151/198 2024-04-14T10:56:47.890 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 151/198 2024-04-14T10:56:47.890 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:47.890 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T10:56:47.891 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:56:47.891 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:56:47.891 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:47.935 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2765.g605eb 152/198 2024-04-14T10:56:47.957 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2765.g605eb 152/198 2024-04-14T10:56:47.957 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:47.957 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T10:56:47.957 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:48.002 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 153/198 2024-04-14T10:56:48.024 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 153/198 2024-04-14T10:56:48.025 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:48.025 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T10:56:48.025 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:56:48.025 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:56:48.025 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:48.327 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 154/198 2024-04-14T10:56:48.350 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 154/198 2024-04-14T10:56:48.350 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:56:48.350 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T10:56:48.350 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:56:48.350 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:56:48.350 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:56:48.401 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 155/198 2024-04-14T10:56:48.449 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.0.0-2765.g605eb165.el9.x86_64 156/198 2024-04-14T10:56:48.478 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T10:56:48.658 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.0.0-2765.g605eb165.el9.x86_64 158/198 2024-04-14T10:56:48.716 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T10:56:48.774 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T10:56:48.833 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T10:56:48.871 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T10:56:48.893 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.0.0-2765.g605eb165.el9.x86_ 163/198 2024-04-14T10:56:48.933 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T10:56:48.963 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T10:56:49.026 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T10:56:49.096 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T10:56:49.153 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T10:56:49.726 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:56:49.767 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:56:49.787 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:56:50.604 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.0.0-2765.g605eb165.el9.noarch 170/198 2024-04-14T10:56:50.695 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T10:56:50.783 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T10:56:50.823 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T10:56:50.848 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T10:56:50.873 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T10:56:50.892 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.893 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.894 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.895 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T10:56:50.896 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: jq-1.6-16.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.897 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.899 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T10:56:50.900 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T10:56:50.901 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T10:56:50.903 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T10:56:50.904 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T10:56:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T10:56:50.905 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T10:56:50.906 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T10:56:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T10:56:50.906 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:56:50.906 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-14T10:56:50.933 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T10:56:50.934 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:56:51.022 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:56:51.051 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T10:56:51.051 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:56:51.135 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:56:51.191 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T10:56:51.220 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T10:56:51.245 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T10:56:51.270 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T10:56:51.304 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T10:56:51.359 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T10:56:51.402 DEBUG:teuthology.parallel:result is None 2024-04-14T10:56:51.408 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:56:51.458 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T10:56:51.484 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:56:51.509 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T10:56:51.515 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:56:51.516 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:56:51.728 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:56:51.729 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:56:51.811 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:56:51.836 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T10:56:51.860 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T10:56:51.887 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T10:56:51.912 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T10:56:51.978 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:56:57.526 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:56:57.526 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.0.0-2765.g605eb165.el9.x86_64 1/198 2024-04-14T10:56:57.526 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 2/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 3/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 4/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2765.g605eb 5/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 6/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 7/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 8/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 9/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 10/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 11/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.0.0-2765.g605eb165.el9.x86_64 12/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 13/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.0.0-2765.g605eb165.el9.x86_64 14/198 2024-04-14T10:56:57.527 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.0.0-2765.g605eb165.el9.x86_ 15/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 16/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 17/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.0.0-2765.g605eb165.el9.x86_6 18/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86 19/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 20/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2765.g605eb165.el 21/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.0.0-2765.g605eb165.el9. 22/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.0.0-2765.g605eb165.el9.x86_6 23/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.0.0-2765.g605eb165.el9.x86_64 24/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.0.0-2765.g605eb165.el9.x86_64 25/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.0.0-2765.g605eb165.el9.x86_64 26/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 27/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 28/198 2024-04-14T10:56:57.528 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.0.0-2765.g605eb165.el9.x86_64 29/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2765.g605eb165. 30/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noa 31/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.n 32/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2765.g605 33/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2765.g605eb165.el 34/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 35/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2765.g605eb165.e 36/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 37/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.0.0-2765.g605eb165.el9.noarch 38/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.0.0-2765.g605eb165.el9.noarch 39/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T10:56:57.529 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T10:56:57.530 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T10:56:57.531 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T10:56:57.532 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T10:56:57.533 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:56:57.534 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T10:56:57.535 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T10:56:57.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.0.0-2765.g605eb165.el9.x86_64 151/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 153/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T10:56:57.537 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T10:56:57.538 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T10:56:57.539 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T10:56:57.540 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T10:57:00.586 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T10:57:00.586 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.587 INFO:teuthology.orchestra.run.smithi084.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T10:57:00.588 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.589 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.0.0-2765.g605eb165.el9.noarch 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T10:57:00.590 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: jq-1.6-16.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T10:57:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T10:57:00.592 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T10:57:00.593 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T10:57:00.594 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T10:57:00.595 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T10:57:00.596 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T10:57:00.597 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T10:57:00.598 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.0.0-2765.g605eb165.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T10:57:00.599 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T10:57:00.600 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T10:57:00.600 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:00.600 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-14T10:57:01.110 DEBUG:teuthology.parallel:result is None 2024-04-14T10:57:01.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:57:01.268 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T10:57:01.290 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-2765.g605eb165.el9 2024-04-14T10:57:01.291 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2765.g605eb165.el9 2024-04-14T10:57:01.291 INFO:teuthology.task.install:The correct ceph version 19.0.0-2765.g605eb165 is installed. 2024-04-14T10:57:01.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:57:01.447 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T10:57:01.473 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-2765.g605eb165.el9 2024-04-14T10:57:01.473 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2765.g605eb165.el9 2024-04-14T10:57:01.473 INFO:teuthology.task.install:The correct ceph version 19.0.0-2765.g605eb165 is installed. 2024-04-14T10:57:01.475 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-14T10:57:01.475 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:01.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T10:57:01.506 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:01.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T10:57:01.548 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-14T10:57:01.548 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:01.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T10:57:01.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T10:57:01.643 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:01.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T10:57:01.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T10:57:01.744 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-14T10:57:01.744 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:01.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T10:57:01.771 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T10:57:01.838 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:01.838 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T10:57:01.868 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T10:57:01.937 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-14T10:57:01.937 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:01.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T10:57:01.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T10:57:02.029 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:02.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T10:57:02.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T10:57:02.126 INFO:teuthology.run_tasks:Running task ceph... 2024-04-14T10:57:02.416 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-14T10:57:02.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-04-14T10:57:02.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-14T10:57:02.447 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-14T10:57:02.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T10:57:02.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T10:57:02.515 INFO:tasks.ceph:Creating extra log directories... 2024-04-14T10:57:02.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T10:57:02.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T10:57:02.590 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-14T10:57:02.590 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-14T10:57:02.622 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-14T10:57:02.622 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:02.622 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T10:57:02.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T10:57:02.751 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T10:57:02.778 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:02.778 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T10:57:02.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T10:57:02.905 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T10:57:02.938 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-14T10:57:02.939 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-14T10:57:02.939 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds-quiesce 2-workunit/fs/snaps}}', 'email': None, 'first_in_suite': False, 'job_id': '7655737', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9221, 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7', 'sleep_before_teardown': 0, 'subset': '111/1000', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXgyYh0ntcjU8Q459AY3n7Iy8nRUlizN+SFU6IxhlTAdkPxg7SdyoP2RcWQcndzZPIILjYaPUOOxHUJyDl7nI=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHxc0VyijjfhsK9GoLH1aUcoMgGCukbOhBrp6uQVoaAN6ShVhDEAB+e4WE/d0UYQAt1wM/kPxZaa+m59lxNS3c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '605eb1656ce49fe7fede4f53b18852ac638918c7', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-14_10:39:28', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-14T10:57:02.940 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T10:57:02.942 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T10:57:02.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T10:57:02.997 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T10:57:03.052 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:03.052 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T10:57:03.076 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T10:57:03.076 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-04-14T10:57:03.130 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-14 10:56:52.317347982 +0000 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-14 10:54:18.344651328 +0000 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-14 10:54:18.344651328 +0000 2024-04-14T10:57:03.131 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-14 10:54:18.344651328 +0000 2024-04-14T10:57:03.131 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T10:57:03.196 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-14T10:57:03.196 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-14T10:57:03.196 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000234151 s, 2.2 MB/s 2024-04-14T10:57:03.197 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T10:57:03.253 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-14 10:56:52.317347982 +0000 2024-04-14T10:57:03.308 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-14 10:54:18.698645076 +0000 2024-04-14T10:57:03.309 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-14 10:54:18.698645076 +0000 2024-04-14T10:57:03.309 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-14 10:54:18.698645076 +0000 2024-04-14T10:57:03.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T10:57:03.373 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-14T10:57:03.374 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-14T10:57:03.374 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000206943 s, 2.5 MB/s 2024-04-14T10:57:03.375 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T10:57:03.431 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-04-14T10:57:03.485 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-14 10:56:52.317347982 +0000 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-14 10:54:19.035639124 +0000 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-14 10:54:19.035639124 +0000 2024-04-14T10:57:03.486 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-14 10:54:19.035639124 +0000 2024-04-14T10:57:03.486 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T10:57:03.551 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-14T10:57:03.552 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-14T10:57:03.552 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000206945 s, 2.5 MB/s 2024-04-14T10:57:03.553 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T10:57:03.610 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-14 10:56:52.318347965 +0000 2024-04-14T10:57:03.665 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-14 10:54:19.393632801 +0000 2024-04-14T10:57:03.666 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-14 10:54:19.393632801 +0000 2024-04-14T10:57:03.666 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-14 10:54:19.393632801 +0000 2024-04-14T10:57:03.666 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T10:57:03.730 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-14T10:57:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-14T10:57:03.731 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000198047 s, 2.6 MB/s 2024-04-14T10:57:03.732 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T10:57:03.788 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:03.788 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:03.788 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T10:57:03.806 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T10:57:03.806 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-14T10:57:03.861 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-14 10:56:42.380245340 +0000 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-14 10:54:18.344553130 +0000 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-14 10:54:18.344553130 +0000 2024-04-14T10:57:03.862 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-14 10:54:18.344553130 +0000 2024-04-14T10:57:03.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T10:57:03.929 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-14T10:57:03.929 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-14T10:57:03.929 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000185721 s, 2.8 MB/s 2024-04-14T10:57:03.930 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T10:57:03.986 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-14 10:56:42.380245340 +0000 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-14 10:54:18.695547706 +0000 2024-04-14T10:57:04.041 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-14 10:54:18.695547706 +0000 2024-04-14T10:57:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-14 10:54:18.695547706 +0000 2024-04-14T10:57:04.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T10:57:04.106 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-14T10:57:04.106 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-14T10:57:04.106 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000190591 s, 2.7 MB/s 2024-04-14T10:57:04.107 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T10:57:04.164 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-14 10:56:42.380245340 +0000 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-14 10:54:19.022542654 +0000 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-14 10:54:19.022542654 +0000 2024-04-14T10:57:04.219 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-14 10:54:19.022542654 +0000 2024-04-14T10:57:04.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T10:57:04.285 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-14T10:57:04.285 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-14T10:57:04.285 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000182643 s, 2.8 MB/s 2024-04-14T10:57:04.286 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T10:57:04.341 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-14 10:56:42.381245325 +0000 2024-04-14T10:57:04.396 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-14 10:54:19.373537231 +0000 2024-04-14T10:57:04.397 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-14 10:54:19.373537231 +0000 2024-04-14T10:57:04.397 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-14 10:54:19.373537231 +0000 2024-04-14T10:57:04.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T10:57:04.461 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-14T10:57:04.461 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-14T10:57:04.461 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000187117 s, 2.7 MB/s 2024-04-14T10:57:04.463 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T10:57:04.519 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:04.519 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T10:57:04.519 INFO:tasks.ceph:Generating config... 2024-04-14T10:57:04.522 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-14T10:57:04.522 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-14T10:57:04.522 INFO:tasks.ceph:[client] debug client = 20 2024-04-14T10:57:04.522 INFO:tasks.ceph:[client] debug ms = 1 2024-04-14T10:57:04.522 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-14T10:57:04.522 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-14T10:57:04.523 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-14T10:57:04.524 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-14T10:57:04.524 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-14T10:57:04.524 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-14T10:57:04.524 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-14T10:57:04.524 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-14T10:57:04.524 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-14T10:57:04.525 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-14T10:57:04.525 INFO:tasks.ceph:Setting up mon.a... 2024-04-14T10:57:04.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-14T10:57:04.585 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.keyring 2024-04-14T10:57:04.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-14T10:57:04.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:57:04.662 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.84'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-04-14T10:57:04.662 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.84,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-14T10:57:04.663 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:04.663 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T10:57:04.717 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.84 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:04.803 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:04.803 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: generated fsid 8f4fd445-3fea-4722-8345-0096c2ce143b 2024-04-14T10:57:04.803 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = quincy 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 0 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:fsid 8f4fd445-3fea-4722-8345-0096c2ce143b 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:last_changed 2024-04-14T10:57:04.804223+0000 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-04-14T10:57:04.804223+0000 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:min_mon_release 17 (quincy) 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:election_strategy: 1 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-04-14T10:57:04.804 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-14T10:57:04.805 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T10:57:04.819 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8f4fd445-3fea-4722-8345-0096c2ce143b... 2024-04-14T10:57:04.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T10:57:04.862 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-04-14T10:57:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = "172.21.15.84,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 8f4fd445-3fea-4722-8345-0096c2ce143b 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-04-14T10:57:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: bdev async discard = True 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: bdev enable discard = True 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore allocator = bitmap 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore block size = 96636764160 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: bluestore fsck on mount = True 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluefs = 1/20 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: debug bluestore = 1/20 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: debug rocksdb = 4/10 2024-04-14T10:57:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd full ratio = 0.9 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd nearfull ratio = 0.8 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: osd blocked scrub grace period = 3600 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: osd failsafe full ratio = 0.95 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: osd max markdown count = 1000 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: osd objectstore = bluestore 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:57:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:57:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: mon down mkfs grace = 300 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: mon op complaint time = 120 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:04.918 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: client mount timeout = 600 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: client_shutdown_timeout = 120 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: debug client = 20 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.b] 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.c] 2024-04-14T10:57:04.919 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:[mds] 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds = 20 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: debug mds balancer = 20 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal fragment size max = 10000 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal merge size = 5 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split bits = 3 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds bal split size = 100 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug frag = True 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds debug scatterstat = True 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds oft prefetch dirfrags = True 2024-04-14T10:57:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: mds op complaint time = 180 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: mds verify scatter = True 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: mds_dir_prefetch = True 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: mds_sleep_rank_change = 5000000.0 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: osd op complaint time = 180 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: rados mon op timeout = 900 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: rados osd op timeout = 900 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-14T10:57:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-14T10:57:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.84,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 8f4fd445-3fea-4722-8345-0096c2ce143b 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-14T10:57:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-14T10:57:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: osd blocked scrub grace period = 3600 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: osd max markdown count = 1000 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-14T10:57:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-14T10:57:04.928 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-14T10:57:04.929 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: mon down mkfs grace = 300 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: client_shutdown_timeout = 120 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-14T10:57:04.930 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.e] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.f] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal fragment size max = 10000 2024-04-14T10:57:04.931 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal merge size = 5 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split bits = 3 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split size = 100 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds oft prefetch dirfrags = True 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds_dir_prefetch = True 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: mds_sleep_rank_change = 5000000.0 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-14T10:57:04.932 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-14T10:57:04.934 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-14T10:57:04.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-14T10:57:05.030 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-14T10:57:05.030 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:05.030 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-14T10:57:05.044 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:05.044 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-14T10:57:05.098 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T10:57:05.099 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:05.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T10:57:05.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:57:05.179 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:05.179 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:05.235 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T10:57:05.235 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:05.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T10:57:05.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:57:05.277 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:05.277 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:05.332 INFO:tasks.ceph:Setting up mon nodes... 2024-04-14T10:57:05.332 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-14T10:57:05.332 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T10:57:05.388 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T10:57:05.391 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T10:57:05.450 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T10:57:05.452 INFO:tasks.ceph:Setting up mds nodes... 2024-04-14T10:57:05.452 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T10:57:05.508 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T10:57:05.511 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-14T10:57:05.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T10:57:05.633 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T10:57:05.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-14T10:57:05.662 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-14T10:57:05.758 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-14T10:57:05.761 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-14T10:57:05.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T10:57:05.843 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T10:57:05.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-14T10:57:05.875 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T10:57:05.969 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T10:57:05.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-14T10:57:05.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-14T10:57:06.093 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-14T10:57:06.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-14T10:57:06.122 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-14T10:57:06.122 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-14T10:57:06.164 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-14T10:57:06.179 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-14T10:57:06.180 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T10:57:06.180 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-14T10:57:06.247 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:06.247 INFO:tasks.ceph:role: osd.0 2024-04-14T10:57:06.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T10:57:06.247 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:06.321 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:06.322 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:06.322 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:06.824 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-04-14T10:57:06.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-04-14T10:57:06.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-14T10:57:06.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-14T10:57:06.980 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-14T10:57:07.047 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:07.047 INFO:tasks.ceph:role: osd.1 2024-04-14T10:57:07.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T10:57:07.047 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T10:57:07.121 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:07.121 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:07.122 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:07.122 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:07.122 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:07.122 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:07.122 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:07.123 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:07.123 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:07.123 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:07.582 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-04-14T10:57:07.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-04-14T10:57:07.585 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-14T10:57:07.667 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-14T10:57:07.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-14T10:57:07.805 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:07.806 INFO:tasks.ceph:role: osd.2 2024-04-14T10:57:07.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T10:57:07.806 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:07.881 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:08.363 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-04-14T10:57:08.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-04-14T10:57:08.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-14T10:57:08.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-14T10:57:08.505 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-14T10:57:08.574 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:08.574 INFO:tasks.ceph:role: osd.3 2024-04-14T10:57:08.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T10:57:08.574 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:08.649 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:08.650 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:08.650 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:08.650 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:09.152 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-04-14T10:57:09.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-04-14T10:57:09.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-14T10:57:09.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-14T10:57:09.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:09.411+0000 7ff74eca6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-14T10:57:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:09.412+0000 7ff74eca6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-14T10:57:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:09.412+0000 7ff74eca6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T10:57:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:09.412+0000 7ff74eca6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T10:57:09.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:09.412+0000 7ff74eca6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T10:57:09.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:09.412+0000 7ff74eca6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-14T10:57:12.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-14T10:57:12.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:12.382+0000 7fa228217640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-14T10:57:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:12.383+0000 7fa228217640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-14T10:57:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:12.383+0000 7fa228217640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T10:57:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:12.383+0000 7fa228217640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T10:57:12.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:12.383+0000 7fa228217640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T10:57:12.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:12.383+0000 7fa228217640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-14T10:57:15.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-14T10:57:15.264 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:15.355+0000 7f964a749640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-14T10:57:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:15.356+0000 7f964a749640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-14T10:57:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:15.356+0000 7f964a749640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T10:57:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:15.356+0000 7f964a749640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T10:57:15.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:15.356+0000 7f964a749640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T10:57:15.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:15.356+0000 7f964a749640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-14T10:57:18.210 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-14T10:57:18.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:18.332+0000 7f5a2c6c8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-14T10:57:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:18.332+0000 7f5a2c6c8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-14T10:57:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:18.332+0000 7f5a2c6c8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T10:57:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:18.332+0000 7f5a2c6c8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T10:57:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:18.332+0000 7f5a2c6c8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T10:57:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:18.333+0000 7f5a2c6c8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-14T10:57:21.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-14T10:57:21.224 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-14T10:57:21.256 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:21.257 INFO:tasks.ceph:role: osd.4 2024-04-14T10:57:21.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T10:57:21.257 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T10:57:21.334 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:21.334 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:21.335 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:21.844 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-14T10:57:21.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-14T10:57:21.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-14T10:57:21.987 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-14T10:57:22.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-14T10:57:22.092 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:22.092 INFO:tasks.ceph:role: osd.5 2024-04-14T10:57:22.092 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T10:57:22.092 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:22.169 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:22.610 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-14T10:57:22.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-14T10:57:22.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-14T10:57:22.703 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-14T10:57:22.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-14T10:57:22.799 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:22.800 INFO:tasks.ceph:role: osd.6 2024-04-14T10:57:22.800 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T10:57:22.800 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T10:57:22.874 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:22.875 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:23.355 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-14T10:57:23.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-14T10:57:23.357 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-14T10:57:23.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-14T10:57:23.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-14T10:57:23.604 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:57:23.605 INFO:tasks.ceph:role: osd.7 2024-04-14T10:57:23.605 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T10:57:23.605 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T10:57:23.679 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:57:23.680 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:57:24.183 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-14T10:57:24.185 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-14T10:57:24.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-14T10:57:24.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-14T10:57:24.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:24.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:24.501+0000 7f15368c1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-14T10:57:24.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:24.502+0000 7f15368c1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-14T10:57:24.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:24.502+0000 7f15368c1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T10:57:24.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:24.502+0000 7f15368c1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T10:57:24.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:24.502+0000 7f15368c1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T10:57:24.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:24.502+0000 7f15368c1640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-14T10:57:27.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-14T10:57:27.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:27.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:27.476+0000 7fcf19549640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-14T10:57:27.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:27.476+0000 7fcf19549640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-14T10:57:27.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:27.476+0000 7fcf19549640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T10:57:27.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:27.476+0000 7fcf19549640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T10:57:27.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:27.476+0000 7fcf19549640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T10:57:27.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:27.477+0000 7fcf19549640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-14T10:57:30.328 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-14T10:57:30.360 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:30.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:30.452+0000 7f10c2a17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-14T10:57:30.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:30.452+0000 7f10c2a17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-14T10:57:30.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:30.452+0000 7f10c2a17640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T10:57:30.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:30.452+0000 7f10c2a17640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T10:57:30.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:30.452+0000 7f10c2a17640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T10:57:30.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:30.453+0000 7f10c2a17640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-14T10:57:32.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:57:32.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:57:33.307 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-14T10:57:33.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:33.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:33.423+0000 7f1481193640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-14T10:57:33.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:33.424+0000 7f1481193640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-14T10:57:33.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:33.424+0000 7f1481193640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T10:57:33.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:33.424+0000 7f1481193640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T10:57:33.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:33.424+0000 7f1481193640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T10:57:33.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:33.424+0000 7f1481193640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-14T10:57:36.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-14T10:57:36.305 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-14T10:57:36.306 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.306 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-14T10:57:36.337 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.337 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-14T10:57:36.408 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-14T10:57:36.478 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.478 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-14T10:57:36.546 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-14T10:57:36.614 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-14T10:57:36.681 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.681 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-14T10:57:36.754 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:36.754 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-14T10:57:36.821 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:36.822 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-14T10:57:36.849 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:36.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-14T10:57:36.916 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:36.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-14T10:57:36.982 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:36.983 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-14T10:57:37.048 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:37.048 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-14T10:57:37.114 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:37.115 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-14T10:57:37.180 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:37.180 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-14T10:57:37.247 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:37.247 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-14T10:57:37.314 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:37.314 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-14T10:57:37.329 INFO:tasks.ceph:Adding keys to all mons... 2024-04-14T10:57:37.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T10:57:37.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T10:57:37.395 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.y] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmq5MxFxAAg2qoMxYtke14ULEEm2jlug== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmZTVYHhAAHvsejsjpGVGl1lp6BScezg== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmvtLNJRAAsRQLe4FkOx7U0MA9l+HwxQ== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmXadCLRAAk9TinvakEffrO+1dAbOK/Q== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCFthtm+UKOGBAALHyWB1OFFIhu8swhcGKyxQ== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCIthtmDQnjFhAAKL6tggdaF/b0562K3wlb8A== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCLthtmZq1EFRAANX5FGTf9xcRuVSdudqofpQ== 2024-04-14T10:57:37.396 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCOthtm6kjfExAAUyKoQAazflYN47xIlUT4ag== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr.x] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmbozfGhAAVdP50MlqlkduQs17gT5sJg== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmf7RPMhAA2/TI8PBBy/NnSRGa8fmtDg== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCBthtmdMzdORAARxZcVeXVzKIRa78SZZXHyg== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCCthtmXR6ZBRAAS+iSZ391/5rXdxlu0Pc1bg== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.4] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCUthtmm6n5HRAA+9RSGsBAcz76plGLVdU1MQ== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.5] 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCXthtmZuZ0HBAAiW3hMslg83LNLCFv4SbkgA== 2024-04-14T10:57:37.397 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.6] 2024-04-14T10:57:37.398 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCathtmhgEGGxAAt6v19zfhDKu8LWsY07ihiw== 2024-04-14T10:57:37.398 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.7] 2024-04-14T10:57:37.398 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCdthtmN39QGRAAEvGmUVQ/MAyRulYY9ArJEg== 2024-04-14T10:57:37.398 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-04-14T10:57:37.398 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQCCthtmeaTZCRAAM7r89AYI6b/0Cn9REdP4PA== 2024-04-14T10:57:37.399 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-04-14T10:57:37.399 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmq5MxFxAAg2qoMxYtke14ULEEm2jlug== 2024-04-14T10:57:37.399 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-14T10:57:37.399 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmZTVYHhAAHvsejsjpGVGl1lp6BScezg== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmvtLNJRAAsRQLe4FkOx7U0MA9l+HwxQ== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.e] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmXadCLRAAk9TinvakEffrO+1dAbOK/Q== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCFthtm+UKOGBAALHyWB1OFFIhu8swhcGKyxQ== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCIthtmDQnjFhAAKL6tggdaF/b0562K3wlb8A== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCLthtmZq1EFRAANX5FGTf9xcRuVSdudqofpQ== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCOthtm6kjfExAAUyKoQAazflYN47xIlUT4ag== 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-04-14T10:57:37.400 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmbozfGhAAVdP50MlqlkduQs17gT5sJg== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmf7RPMhAA2/TI8PBBy/NnSRGa8fmtDg== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCBthtmdMzdORAARxZcVeXVzKIRa78SZZXHyg== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.f] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCCthtmXR6ZBRAAS+iSZ391/5rXdxlu0Pc1bg== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCUthtmm6n5HRAA+9RSGsBAcz76plGLVdU1MQ== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCXthtmZuZ0HBAAiW3hMslg83LNLCFv4SbkgA== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCathtmhgEGGxAAt6v19zfhDKu8LWsY07ihiw== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCdthtmN39QGRAAEvGmUVQ/MAyRulYY9ArJEg== 2024-04-14T10:57:37.401 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-14T10:57:37.402 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQCCthtmeaTZCRAAM7r89AYI6b/0Cn9REdP4PA== 2024-04-14T10:57:37.402 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:57:37.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:57:37.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.497 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.551 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.610 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.664 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.666 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.718 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.772 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.774 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:37.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:57:37.882 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:57:37.933 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.990 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:37.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:38.047 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:38.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:57:38.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.159 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.161 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.215 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.267 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:57:38.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T10:57:38.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T10:57:38.378 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-14T10:57:38.379 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-14T10:57:38.406 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T10:57:38.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-14T10:57:38.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-14T10:57:38.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T10:57:38.656 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-14T10:57:38.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-14T10:57:38.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T10:57:38.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-14T10:57:38.874 DEBUG:teuthology.orchestra.run.smithi084:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:38.876 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:57:38.929 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-14T10:57:38.929 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-14T10:57:38.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-14T10:57:38.932 INFO:tasks.ceph.mon.a:Started 2024-04-14T10:57:38.932 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-14T10:57:38.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-14T10:57:38.971 INFO:tasks.ceph.mon.b:Started 2024-04-14T10:57:38.972 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-14T10:57:38.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-14T10:57:38.974 INFO:tasks.ceph.mon.c:Started 2024-04-14T10:57:38.974 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-14T10:57:38.974 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-14T10:57:38.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-14T10:57:38.976 INFO:tasks.ceph.mgr.y:Started 2024-04-14T10:57:38.976 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-14T10:57:38.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-14T10:57:38.978 INFO:tasks.ceph.mgr.x:Started 2024-04-14T10:57:38.978 INFO:tasks.ceph:Setting crush tunables to default 2024-04-14T10:57:38.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd crush tunables default 2024-04-14T10:57:39.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.080+0000 7f58fd91e640 1 Processor -- start 2024-04-14T10:57:39.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.080+0000 7f58fd91e640 1 -- start start 2024-04-14T10:57:39.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58fd91e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 0x7f58f80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58fd91e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 0x7f58f815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58fd91e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f815ad20 con 0x7f58f806f8c0 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58fd91e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f58f815b070 con 0x7f58f80c3d50 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58fd91e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f58f806fd90 con 0x7f58f80ca580 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f6ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 0x7f58f80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f77fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f58f806f8c0 0x7f58f806e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53260/0 (socket says 172.21.15.84:53260) 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f77fe640 1 -- 172.21.15.84:0/999247451 learned_addr learned my addr 172.21.15.84:0/999247451 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f6ffd640 1 -- 172.21.15.84:0/999247451 >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 msgr2=0x7f58f80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f6ffd640 1 -- 172.21.15.84:0/999247451 >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 msgr2=0x7f58f80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 0x7f58f80ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 0x7f58f80ca040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f67fc640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 0x7f58f815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f67fc640 1 -- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 msgr2=0x7f58f815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f67fc640 1 -- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 msgr2=0x7f58f815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:57:39.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f67fc640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 0x7f58f815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:57:39.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.081+0000 7f58f67fc640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 0x7f58f815b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103460736 0 0) 0x7f58f815ad20 con 0x7f58f806f8c0 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58e0003520 con 0x7f58f806f8c0 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3829890358 0 0) 0x7f58e0003520 con 0x7f58f806f8c0 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 msgr2=0x7f58f815b500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.175:3300/0 conn(0x7f58f80ca580 0x7f58f815b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 msgr2=0x7f58f80ca040 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:57:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 --2- 172.21.15.84:0/999247451 >> v2:172.21.15.84:3300/0 conn(0x7f58f80c3d50 0x7f58f80ca040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f8070070 con 0x7f58f806f8c0 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7f58f0001670 con 0x7f58f806f8c0 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 >> v1:172.21.15.84:6789/0 conn(0x7f58f806f8c0 legacy=0x7f58f806e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0004800 0x7f58e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e00051c0 0x7f58e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f58f815b070 con 0x7f58e0003a00 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58f806fd90 con 0x7f58e00051c0 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58e000c110 con 0x7f58e0004800 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.236+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f67fc640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0004800 0x7f58e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f77fe640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e00051c0 0x7f58e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f6ffd640 1 -- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0004800 msgr2=0x7f58e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0004800 0x7f58e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f6ffd640 1 -- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e00051c0 msgr2=0x7f58e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e00051c0 0x7f58e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f6ffd640 1 -- 172.21.15.84:0/999247451 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e0003520 con 0x7f58e0003a00 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f77fe640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e00051c0 0x7f58e000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f77fe640 1 -- 172.21.15.84:0/999247451 reap_dead start 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.237+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58e0003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009fd0 tx=0x7f58e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e5d40651ef54e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8039070 con 0x7f58e0003a00 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e802cca0 con 0x7f58e0003a00 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58f5ffb640 1 -- 172.21.15.84:0/999247451 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8009bd0 con 0x7f58e0003a00 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 -- 172.21.15.84:0/999247451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 msgr2=0x7f58e0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58e0003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009fd0 tx=0x7f58e0005830 comp rx=0 tx=0).stop 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 -- 172.21.15.84:0/999247451 shutdown_connections 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 --2- 172.21.15.84:0/999247451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58e0003e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 -- 172.21.15.84:0/999247451 >> 172.21.15.84:0/999247451 conn(0x7f58f80cd550 msgr2=0x7f58f80c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 -- 172.21.15.84:0/999247451 shutdown_connections 2024-04-14T10:57:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.238+0000 7f58fd91e640 1 -- 172.21.15.84:0/999247451 wait complete. 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.239+0000 7f58fd91e640 1 Processor -- start 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 -- start start 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58f81417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58f813f4e0 0x7f58f8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58f8159750 0x7f58f806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f58f80cb2f0 con 0x7f58e0003a00 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58f8070630 con 0x7f58f813f4e0 2024-04-14T10:57:39.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58fd91e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58f80ca040 con 0x7f58f8159750 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58f6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58f81417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58f6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58f81417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56442/0 (socket says 172.21.15.84:56442) 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58f6ffd640 1 -- 172.21.15.84:0/636913044 learned_addr learned my addr 172.21.15.84:0/636913044 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.240+0000 7f58f67fc640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58f813f4e0 0x7f58f8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f77fe640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58f8159750 0x7f58f806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f6ffd640 1 -- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58f8159750 msgr2=0x7f58f806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58f8159750 0x7f58f806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f6ffd640 1 -- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58f813f4e0 msgr2=0x7f58f8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58f813f4e0 0x7f58f8159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f6ffd640 1 -- 172.21.15.84:0/636913044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f81f25b0 con 0x7f58e0003a00 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58f6ffd640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58f81417a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58e8007420 tx=0x7f58e8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8044020 con 0x7f58e0003a00 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e802ce50 con 0x7f58e0003a00 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f81e6b70 con 0x7f58e0003a00 2024-04-14T10:57:39.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e8039040 con 0x7f58e0003a00 2024-04-14T10:57:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f8158cf0 con 0x7f58e0003a00 2024-04-14T10:57:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58e8047020 con 0x7f58e0003a00 2024-04-14T10:57:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.241+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f58e8040820 con 0x7f58e0003a00 2024-04-14T10:57:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.242+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f8154e10 con 0x7f58e0003a00 2024-04-14T10:57:39.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.244+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f58f8154e10 con 0x7f58e0003a00 2024-04-14T10:57:39.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.311+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f58f8069b20 con 0x7f58e0003a00 2024-04-14T10:57:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.313+0000 7f58dffff640 1 -- 172.21.15.84:0/636913044 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f58e804e030 con 0x7f58e0003a00 2024-04-14T10:57:39.312 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 msgr2=0x7f58f81417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58f81417a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58e8007420 tx=0x7f58e8004ab0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 shutdown_connections 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58f8159750 0x7f58f806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58f813f4e0 0x7f58f8159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 --2- 172.21.15.84:0/636913044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f58e0003a00 0x7f58f81417a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 >> 172.21.15.84:0/636913044 conn(0x7f58f80cd550 msgr2=0x7f58f80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 shutdown_connections 2024-04-14T10:57:39.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:39.314+0000 7f58fd91e640 1 -- 172.21.15.84:0/636913044 wait complete. 2024-04-14T10:57:39.325 INFO:tasks.ceph:check_enable_crimson: False 2024-04-14T10:57:39.325 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-14T10:57:39.325 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:39.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-14T10:57:39.353 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:39.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-14T10:57:39.420 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:39.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-14T10:57:39.488 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T10:57:39.488 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-14T10:57:39.556 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:39.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-14T10:57:39.583 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:39.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-14T10:57:39.650 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:39.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-14T10:57:39.710 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:39.711+0000 7f1a2c040040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T10:57:39.717 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-14T10:57:39.717 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-14T10:57:39.733 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:39.734+0000 7fd5641f1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T10:57:39.767 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:39.767+0000 7f1a2c040040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T10:57:39.784 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 0e6df873-1067-4c9b-8da2-bfa07bdc180a 0 2024-04-14T10:57:39.787 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:39.787+0000 7fd5641f1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T10:57:39.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.924+0000 7f7001b9c640 1 Processor -- start 2024-04-14T10:57:39.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.924+0000 7f7001b9c640 1 -- start start 2024-04-14T10:57:39.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f7001b9c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f6ffc0ca350 0x7f6ffc1643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f7001b9c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc15c3f0 con 0x7f6ffc152f80 2024-04-14T10:57:39.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f7001b9c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ffc15c6b0 con 0x7f6ffc06fb10 2024-04-14T10:57:39.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f7001b9c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6ffc0c4b30 con 0x7f6ffc0ca350 2024-04-14T10:57:39.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f6ffaffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6ffc06fb10 0x7f6ffc0c9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38892/0 (socket says 172.21.15.175:38892) 2024-04-14T10:57:39.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f6ffaffd640 1 -- 172.21.15.175:0/2212715148 learned_addr learned my addr 172.21.15.175:0/2212715148 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.925+0000 7f6ffbfff640 1 --2- 172.21.15.175:0/2212715148 >> v2:172.21.15.84:3300/0 conn(0x7f6ffc0ca350 0x7f6ffc1643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430655152 0 0) 0x7f6ffc15c6b0 con 0x7f6ffc06fb10 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fe4003520 con 0x7f6ffc06fb10 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075014998 0 0) 0x7f6ffc15c3f0 con 0x7f6ffc152f80 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc15c6b0 con 0x7f6ffc152f80 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3802557217 0 0) 0x7f6fe4003520 con 0x7f6ffc06fb10 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 >> v2:172.21.15.84:3300/0 conn(0x7f6ffc0ca350 msgr2=0x7f6ffc1643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 --2- 172.21.15.175:0/2212715148 >> v2:172.21.15.84:3300/0 conn(0x7f6ffc0ca350 0x7f6ffc1643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 >> v1:172.21.15.84:6789/0 conn(0x7f6ffc152f80 legacy=0x7f6ffc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc15c990 con 0x7f6ffc06fb10 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7f6fec001670 con 0x7f6ffc06fb10 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 >> v1:172.21.15.175:6789/0 conn(0x7f6ffc06fb10 legacy=0x7f6ffc0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4003b40 0x7f6fe4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6fe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe40051c0 0x7f6fe400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc0c4b30 con 0x7f6fe4003b40 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe400c040 con 0x7f6fe4004800 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe400c240 con 0x7f6fe40051c0 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffaffd640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6fe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffbfff640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe40051c0 0x7f6fe400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffb7fe640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4003b40 0x7f6fe4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffaffd640 1 -- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe40051c0 msgr2=0x7f6fe400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffaffd640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe40051c0 0x7f6fe400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffaffd640 1 -- 172.21.15.175:0/2212715148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4003b40 msgr2=0x7f6fe4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffaffd640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4003b40 0x7f6fe4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffaffd640 1 -- 172.21.15.175:0/2212715148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4003520 con 0x7f6fe4004800 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffb7fe640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fe4003b40 0x7f6fe4003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:57:39.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.926+0000 7f6ffbfff640 1 -- 172.21.15.175:0/2212715148 reap_dead start 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.927+0000 7f6ffaffd640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6fe4004c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c210 tx=0x7f6fe4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6430ebadfee6924 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.927+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec007ce0 con 0x7f6fe4004800 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.927+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec030070 con 0x7f6fe4004800 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.927+0000 7f6ffa7fc640 1 -- 172.21.15.175:0/2212715148 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec005d90 con 0x7f6fe4004800 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 -- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 msgr2=0x7f6fe4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6fe4004c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c210 tx=0x7f6fe4005830 comp rx=0 tx=0).stop 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 -- 172.21.15.175:0/2212715148 shutdown_connections 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 --2- 172.21.15.175:0/2212715148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6fe4004c80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 -- 172.21.15.175:0/2212715148 >> 172.21.15.175:0/2212715148 conn(0x7f6ffc067db0 msgr2=0x7f6ffc0716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 -- 172.21.15.175:0/2212715148 shutdown_connections 2024-04-14T10:57:39.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.928+0000 7f7001b9c640 1 -- 172.21.15.175:0/2212715148 wait complete. 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.929+0000 7f7001b9c640 1 Processor -- start 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.929+0000 7f7001b9c640 1 -- start start 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f7001b9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6ffc0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f7001b9c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ffc1f0800 0x7f6ffc06cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f7001b9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ffc14f6e0 0x7f6ffc14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f7001b9c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc0c97b0 con 0x7f6ffc1f0800 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f7001b9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc15cf50 con 0x7f6fe4004800 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f7001b9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6ffc15c040 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6ffc0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ffc14f6e0 0x7f6ffc14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6ffc0cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51028/0 (socket says 172.21.15.175:51028) 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffb7fe640 1 -- 172.21.15.175:0/1662833990 learned_addr learned my addr 172.21.15.175:0/1662833990 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffaffd640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ffc1f0800 0x7f6ffc06cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffbfff640 1 -- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 msgr2=0x7f6ffc0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffbfff640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6ffc0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffbfff640 1 -- 172.21.15.175:0/1662833990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ffc1f0800 msgr2=0x7f6ffc06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffbfff640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ffc1f0800 0x7f6ffc06cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.930+0000 7f6ffbfff640 1 -- 172.21.15.175:0/1662833990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc0cd700 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6ffb7fe640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6ffc0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6ffbfff640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ffc14f6e0 0x7f6ffc14fb90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0cbf00 tx=0x7f6ff400f1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4003e60 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff401c070 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc06ba80 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff400fb10 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc06c040 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ff400fcb0 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.931+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6ff4021840 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.932+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ffc069b20 con 0x7f6ffc14f6e0 2024-04-14T10:57:39.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:39.934+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ff4010040 con 0x7f6ffc14f6e0 2024-04-14T10:57:40.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.006+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0e6df873-1067-4c9b-8da2-bfa07bdc180a", "id": 0} v 0) -- 0x7f6ffc0c4170 con 0x7f6ffc14f6e0 2024-04-14T10:57:40.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.009+0000 7f6fe3fff640 1 -- 172.21.15.175:0/1662833990 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e6df873-1067-4c9b-8da2-bfa07bdc180a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6ff4021bc0 con 0x7f6ffc14f6e0 2024-04-14T10:57:40.009 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ffc14f6e0 msgr2=0x7f6ffc14fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ffc14f6e0 0x7f6ffc14fb90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0cbf00 tx=0x7f6ff400f1b0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 shutdown_connections 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ffc14f6e0 0x7f6ffc14fb90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ffc1f0800 0x7f6ffc06cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 --2- 172.21.15.175:0/1662833990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe4004800 0x7f6ffc0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 >> 172.21.15.175:0/1662833990 conn(0x7f6ffc067db0 msgr2=0x7f6ffc15a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 shutdown_connections 2024-04-14T10:57:40.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.010+0000 7f7001b9c640 1 -- 172.21.15.175:0/1662833990 wait complete. 2024-04-14T10:57:40.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 6b17ad9e-a491-45e4-8731-7922ba981947 1 2024-04-14T10:57:40.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.123+0000 7f951115e640 1 Processor -- start 2024-04-14T10:57:40.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.123+0000 7f951115e640 1 -- start start 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f951115e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f950c151e20 0x7f950c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f951115e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f951115e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950c158a30 con 0x7f950c06b900 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f951115e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f950c0c4970 con 0x7f950c151e20 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f951115e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f950c0735e0 con 0x7f950c0c7120 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950ad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f950c151e20 0x7f950c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:53956/0 (socket says 172.21.15.175:53956) 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950ad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f950c151e20 0x7f950c1584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51036/0 (socket says 172.21.15.175:51036) 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950b59e640 1 -- 172.21.15.175:0/3683990891 learned_addr learned my addr 172.21.15.175:0/3683990891 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950ad9d640 1 -- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 msgr2=0x7f950c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950ad9d640 1 --2- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950ad9d640 1 -- 172.21.15.175:0/3683990891 >> v1:172.21.15.84:6789/0 conn(0x7f950c06b900 legacy=0x7f950c072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.124+0000 7f950ad9d640 1 -- 172.21.15.175:0/3683990891 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c0c4bc0 con 0x7f950c151e20 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.125+0000 7f950b59e640 1 --2- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.125+0000 7f950ad9d640 1 --2- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c151e20 0x7f950c1584f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95000097a0 tx=0x7f950002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3b4b8774cb8283 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.125+0000 7f9509d9b640 1 -- 172.21.15.175:0/3683990891 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500031780 con 0x7f950c151e20 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.125+0000 7f9509d9b640 1 -- 172.21.15.175:0/3683990891 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9500037070 con 0x7f950c151e20 2024-04-14T10:57:40.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.125+0000 7f9509d9b640 1 -- 172.21.15.175:0/3683990891 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500031b40 con 0x7f950c151e20 2024-04-14T10:57:40.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 -- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c151e20 msgr2=0x7f950c1584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 --2- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c151e20 0x7f950c1584f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95000097a0 tx=0x7f950002b820 comp rx=0 tx=0).stop 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 -- 172.21.15.175:0/3683990891 shutdown_connections 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 --2- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 --2- 172.21.15.175:0/3683990891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c151e20 0x7f950c1584f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 -- 172.21.15.175:0/3683990891 >> 172.21.15.175:0/3683990891 conn(0x7f950c0c9f70 msgr2=0x7f950c0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 -- 172.21.15.175:0/3683990891 shutdown_connections 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.126+0000 7f951115e640 1 -- 172.21.15.175:0/3683990891 wait complete. 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.127+0000 7f951115e640 1 Processor -- start 2024-04-14T10:57:40.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.127+0000 7f951115e640 1 -- start start 2024-04-14T10:57:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f951115e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 0x7f950c145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f951115e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c1f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f951115e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f950c151e20 0x7f950c1f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f951115e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f950c157fd0 con 0x7f950c151e20 2024-04-14T10:57:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f951115e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f950c157cf0 con 0x7f950c06b900 2024-04-14T10:57:40.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f951115e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f950c152200 con 0x7f950c0c7120 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f950ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 0x7f950c145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f950a59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c1f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f950ad9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 0x7f950c145170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51038/0 (socket says 172.21.15.175:51038) 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f950ad9d640 1 -- 172.21.15.175:0/2416756681 learned_addr learned my addr 172.21.15.175:0/2416756681 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.128+0000 7f950b59e640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f950c151e20 0x7f950c1f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950ad9d640 1 -- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 msgr2=0x7f950c1f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950ad9d640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c1f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950ad9d640 1 -- 172.21.15.175:0/2416756681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f950c151e20 msgr2=0x7f950c1f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950ad9d640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f950c151e20 0x7f950c1f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950ad9d640 1 -- 172.21.15.175:0/2416756681 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c0cd140 con 0x7f950c06b900 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950a59c640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c1f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f950ad9d640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 0x7f950c145170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9500034040 tx=0x7f95000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500032610 con 0x7f950c06b900 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95000327b0 con 0x7f950c06b900 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500032ba0 con 0x7f950c06b900 2024-04-14T10:57:40.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c0ccb80 con 0x7f950c06b900 2024-04-14T10:57:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c157040 con 0x7f950c06b900 2024-04-14T10:57:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f950004e7d0 con 0x7f950c06b900 2024-04-14T10:57:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.129+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f9500045b70 con 0x7f950c06b900 2024-04-14T10:57:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.130+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f950c069b20 con 0x7f950c06b900 2024-04-14T10:57:40.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.132+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9500064e50 con 0x7f950c06b900 2024-04-14T10:57:40.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.205+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6b17ad9e-a491-45e4-8731-7922ba981947", "id": 1} v 0) -- 0x7f950c147830 con 0x7f950c06b900 2024-04-14T10:57:40.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.208+0000 7f94f37fe640 1 -- 172.21.15.175:0/2416756681 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b17ad9e-a491-45e4-8731-7922ba981947", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f9500053030 con 0x7f950c06b900 2024-04-14T10:57:40.208 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 msgr2=0x7f950c145170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 0x7f950c145170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9500034040 tx=0x7f95000046c0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 shutdown_connections 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f950c151e20 0x7f950c1f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f950c0c7120 0x7f950c1f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 --2- 172.21.15.175:0/2416756681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f950c06b900 0x7f950c145170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 >> 172.21.15.175:0/2416756681 conn(0x7f950c0c9f70 msgr2=0x7f950c072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 shutdown_connections 2024-04-14T10:57:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.209+0000 7f951115e640 1 -- 172.21.15.175:0/2416756681 wait complete. 2024-04-14T10:57:40.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 4f3b473c-f0b1-450d-83a3-8789467829e7 2 2024-04-14T10:57:40.311 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.311+0000 7fd5641f1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T10:57:40.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f40008b7640 1 Processor -- start 2024-04-14T10:57:40.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f40008b7640 1 -- start start 2024-04-14T10:57:40.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f40008b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ffc0c7120 0x7f3ffc0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f40008b7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ffc0c4bc0 con 0x7f3ffc151e20 2024-04-14T10:57:40.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f40008b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ffc0c4ea0 con 0x7f3ffc06b900 2024-04-14T10:57:40.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f40008b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3ffc0c4970 con 0x7f3ffc0c7120 2024-04-14T10:57:40.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f3ffad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ffc0c7120 0x7f3ffc0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f3ff3fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3ffc06b900 0x7f3ffc072990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38902/0 (socket says 172.21.15.175:38902) 2024-04-14T10:57:40.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.321+0000 7f3ff3fff640 1 -- 172.21.15.175:0/2295013592 learned_addr learned my addr 172.21.15.175:0/2295013592 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-14T10:57:40.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.322+0000 7f3ffad9d640 1 -- 172.21.15.175:0/2295013592 >> v1:172.21.15.175:6789/0 conn(0x7f3ffc06b900 legacy=0x7f3ffc072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.322+0000 7f3ffad9d640 1 -- 172.21.15.175:0/2295013592 >> v1:172.21.15.84:6789/0 conn(0x7f3ffc151e20 legacy=0x7f3ffc1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.322+0000 7f3ffad9d640 1 -- 172.21.15.175:0/2295013592 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc157cf0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.322+0000 7f3ff9d9b640 1 -- 172.21.15.175:0/2295013592 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733869012 0 0) 0x7f3ffc0c4ea0 con 0x7f3ffc06b900 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.322+0000 7f3ffad9d640 1 --2- 172.21.15.175:0/2295013592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc0730a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0c4af0 tx=0x7f3ff402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41e40cdf3e831fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f3ff9d9b640 1 -- 172.21.15.175:0/2295013592 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4039070 con 0x7f3ffc0c7120 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f3ff9d9b640 1 -- 172.21.15.175:0/2295013592 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff402cce0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f3ff9d9b640 1 -- 172.21.15.175:0/2295013592 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4034660 con 0x7f3ffc0c7120 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 -- 172.21.15.175:0/2295013592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 msgr2=0x7f3ffc0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 --2- 172.21.15.175:0/2295013592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc0730a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0c4af0 tx=0x7f3ff402bf30 comp rx=0 tx=0).stop 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 -- 172.21.15.175:0/2295013592 shutdown_connections 2024-04-14T10:57:40.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 --2- 172.21.15.175:0/2295013592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc0730a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 -- 172.21.15.175:0/2295013592 >> 172.21.15.175:0/2295013592 conn(0x7f3ffc0c9f70 msgr2=0x7f3ffc0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 -- 172.21.15.175:0/2295013592 shutdown_connections 2024-04-14T10:57:40.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.323+0000 7f40008b7640 1 -- 172.21.15.175:0/2295013592 wait complete. 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.324+0000 7f40008b7640 1 Processor -- start 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.324+0000 7f40008b7640 1 -- start start 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f40008b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ffc06b900 0x7f3ffc155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f40008b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f40008b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 0x7f3ffc1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f40008b7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc152200 con 0x7f3ffc06b900 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f40008b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc0735e0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f40008b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc06cdf0 con 0x7f3ffc151e20 2024-04-14T10:57:40.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f3ff3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f3ffad9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 0x7f3ffc1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f3ffad9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 0x7f3ffc1461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:53976/0 (socket says 172.21.15.175:53976) 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f3ffad9d640 1 -- 172.21.15.175:0/2868830455 learned_addr learned my addr 172.21.15.175:0/2868830455 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.325+0000 7f3ffa59c640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ffc06b900 0x7f3ffc155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff3fff640 1 -- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 msgr2=0x7f3ffc1461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff3fff640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 0x7f3ffc1461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff3fff640 1 -- 172.21.15.175:0/2868830455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ffc06b900 msgr2=0x7f3ffc155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff3fff640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ffc06b900 0x7f3ffc155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff3fff640 1 -- 172.21.15.175:0/2868830455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc1578c0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ffad9d640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 0x7f3ffc1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff3fff640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc157380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc06bd20 tx=0x7f3fe400c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40074e0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe4007680 con 0x7f3ffc0c7120 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc155f70 con 0x7f3ffc0c7120 2024-04-14T10:57:40.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4004a00 con 0x7f3ffc0c7120 2024-04-14T10:57:40.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc1568a0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3fe4011070 con 0x7f3ffc0c7120 2024-04-14T10:57:40.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.326+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3fe40137e0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.327+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc155710 con 0x7f3ffc0c7120 2024-04-14T10:57:40.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.329+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3ffc155710 con 0x7f3ffc0c7120 2024-04-14T10:57:40.334 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.334+0000 7f1a2c040040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T10:57:40.365 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.365+0000 7fd5641f1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T10:57:40.390 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.390+0000 7f1a2c040040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T10:57:40.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.402+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f3b473c-f0b1-450d-83a3-8789467829e7", "id": 2} v 0) -- 0x7f3ffc069b20 con 0x7f3ffc0c7120 2024-04-14T10:57:40.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.408+0000 7f3ff2ffd640 1 -- 172.21.15.175:0/2868830455 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f3b473c-f0b1-450d-83a3-8789467829e7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3fe4004bf0 con 0x7f3ffc0c7120 2024-04-14T10:57:40.407 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 msgr2=0x7f3ffc157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc157380 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc06bd20 tx=0x7f3fe400c870 comp rx=0 tx=0).stop 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 shutdown_connections 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ffc151e20 0x7f3ffc1461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ffc0c7120 0x7f3ffc157380 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 --2- 172.21.15.175:0/2868830455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ffc06b900 0x7f3ffc155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 >> 172.21.15.175:0/2868830455 conn(0x7f3ffc0c9f70 msgr2=0x7f3ffc14f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 shutdown_connections 2024-04-14T10:57:40.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.409+0000 7f40008b7640 1 -- 172.21.15.175:0/2868830455 wait complete. 2024-04-14T10:57:40.410 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.410+0000 7fd5641f1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T10:57:40.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 406a1d3c-5134-45a7-8b6f-b7b8f3631f88 3 2024-04-14T10:57:40.439 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.439+0000 7f1a2c040040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T10:57:40.463 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.464+0000 7fd5641f1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T10:57:40.496 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.496+0000 7f1a2c040040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T10:57:40.505 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.506+0000 7fd5641f1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T10:57:40.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.520+0000 7ff2aafb4640 1 Processor -- start 2024-04-14T10:57:40.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 -- start start 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2a4152fe0 0x7ff2a40c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a40c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2a406ba20 0x7ff2a415c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a41533c0 con 0x7ff2a406ba20 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff2a4072f10 con 0x7ff2a4152fe0 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2aafb4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a40c9550 con 0x7ff2a4072990 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2a8d50640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2a4152fe0 0x7ff2a40c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2a3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a40c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2a8d50640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2a4152fe0 0x7ff2a40c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51058/0 (socket says 172.21.15.175:51058) 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.521+0000 7ff2a8d50640 1 -- 172.21.15.175:0/2677219103 learned_addr learned my addr 172.21.15.175:0/2677219103 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a9551640 1 --2- 172.21.15.175:0/2677219103 >> v2:172.21.15.84:3300/0 conn(0x7ff2a406ba20 0x7ff2a415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a8d50640 1 -- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 msgr2=0x7ff2a40c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a8d50640 1 --2- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a40c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a8d50640 1 -- 172.21.15.175:0/2677219103 >> v2:172.21.15.84:3300/0 conn(0x7ff2a406ba20 msgr2=0x7ff2a415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a8d50640 1 --2- 172.21.15.175:0/2677219103 >> v2:172.21.15.84:3300/0 conn(0x7ff2a406ba20 0x7ff2a415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a8d50640 1 -- 172.21.15.175:0/2677219103 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a4073d30 con 0x7ff2a4152fe0 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.522+0000 7ff2a8d50640 1 --2- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a40c6b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40c78c0 tx=0x7ff29802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a7ffd0f290c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2a37fe640 1 -- 172.21.15.175:0/2677219103 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298035020 con 0x7ff2a4152fe0 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2a37fe640 1 -- 172.21.15.175:0/2677219103 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff298031640 con 0x7ff2a4152fe0 2024-04-14T10:57:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2a37fe640 1 -- 172.21.15.175:0/2677219103 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29802d040 con 0x7ff2a4152fe0 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 -- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 msgr2=0x7ff2a40c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a40c6b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40c78c0 tx=0x7ff29802b8f0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 -- 172.21.15.175:0/2677219103 shutdown_connections 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/2677219103 >> v2:172.21.15.84:3300/0 conn(0x7ff2a406ba20 0x7ff2a415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a40c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/2677219103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a40c6b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 -- 172.21.15.175:0/2677219103 >> 172.21.15.175:0/2677219103 conn(0x7ff2a40c9f70 msgr2=0x7ff2a40ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 -- 172.21.15.175:0/2677219103 shutdown_connections 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.523+0000 7ff2aafb4640 1 -- 172.21.15.175:0/2677219103 wait complete. 2024-04-14T10:57:40.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.524+0000 7ff2aafb4640 1 Processor -- start 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.524+0000 7ff2aafb4640 1 -- start start 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2aafb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a406ba20 0x7ff2a4153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2aafb4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a41f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2aafb4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2aafb4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4073a50 con 0x7ff2a406ba20 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2aafb4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a40c7fa0 con 0x7ff2a4152fe0 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2aafb4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2a40c8240 con 0x7ff2a4072990 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2a9551640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2a3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a41f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2a9551640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a414edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51070/0 (socket says 172.21.15.175:51070) 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2a9551640 1 -- 172.21.15.175:0/3955125826 learned_addr learned my addr 172.21.15.175:0/3955125826 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.525+0000 7ff2a8d50640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a406ba20 0x7ff2a4153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a9551640 1 -- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 msgr2=0x7ff2a41f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a9551640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a41f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a9551640 1 -- 172.21.15.175:0/3955125826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a406ba20 msgr2=0x7ff2a4153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a9551640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a406ba20 0x7ff2a4153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a9551640 1 -- 172.21.15.175:0/3955125826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a414fa00 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a3fff640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a41f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a9551640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a414edb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff29c007d20 tx=0x7ff29c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c014420 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29c019070 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c014820 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a41e5b30 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a41f0ed0 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff29c0149c0 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.526+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff29c01d850 con 0x7ff2a4152fe0 2024-04-14T10:57:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.527+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a40c9710 con 0x7ff2a4152fe0 2024-04-14T10:57:40.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.529+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff2a40c9710 con 0x7ff2a4152fe0 2024-04-14T10:57:40.541 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.542+0000 7f1a2c040040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T10:57:40.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.602+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "406a1d3c-5134-45a7-8b6f-b7b8f3631f88", "id": 3} v 0) -- 0x7ff2a4068d80 con 0x7ff2a4152fe0 2024-04-14T10:57:40.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.608+0000 7ff2a17fa640 1 -- 172.21.15.175:0/3955125826 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "406a1d3c-5134-45a7-8b6f-b7b8f3631f88", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff2a4068d80 con 0x7ff2a4152fe0 2024-04-14T10:57:40.607 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-04-14T10:57:40.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 msgr2=0x7ff2a414edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a414edb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff29c007d20 tx=0x7ff29c00e4b0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 shutdown_connections 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2a4152fe0 0x7ff2a414edb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2a4072990 0x7ff2a41f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 --2- 172.21.15.175:0/3955125826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2a406ba20 0x7ff2a4153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 >> 172.21.15.175:0/3955125826 conn(0x7ff2a40c9f70 msgr2=0x7ff2a40702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 shutdown_connections 2024-04-14T10:57:40.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.609+0000 7ff2aafb4640 1 -- 172.21.15.175:0/3955125826 wait complete. 2024-04-14T10:57:40.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8 4 2024-04-14T10:57:40.621 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.622+0000 7fd5641f1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T10:57:40.663 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.664+0000 7f1a2c040040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T10:57:40.690 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.691+0000 7fd5641f1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T10:57:40.736 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.736+0000 7fd5641f1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T10:57:40.738 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.738+0000 7f1a2c040040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T10:57:40.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.760+0000 7fb588f9c640 1 Processor -- start 2024-04-14T10:57:40.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.760+0000 7fb588f9c640 1 -- start start 2024-04-14T10:57:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb588f9c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb58406f1a0 0x7fb5840ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb588f9c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5840c95a0 con 0x7fb5840ce8d0 2024-04-14T10:57:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb588f9c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58415afd0 con 0x7fb584154ff0 2024-04-14T10:57:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb588f9c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb58415e3d0 con 0x7fb58406f1a0 2024-04-14T10:57:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb57bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb58406f1a0 0x7fb5840ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb58259c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb584154ff0 0x7fb58406f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38912/0 (socket says 172.21.15.175:38912) 2024-04-14T10:57:40.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb57bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb58406f1a0 0x7fb5840ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51078/0 (socket says 172.21.15.175:51078) 2024-04-14T10:57:40.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb58259c640 1 -- 172.21.15.175:0/2883654603 learned_addr learned my addr 172.21.15.175:0/2883654603 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-14T10:57:40.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb57bfff640 1 -- 172.21.15.175:0/2883654603 >> v1:172.21.15.175:6789/0 conn(0x7fb584154ff0 legacy=0x7fb58406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb57bfff640 1 -- 172.21.15.175:0/2883654603 >> v1:172.21.15.84:6789/0 conn(0x7fb5840ce8d0 legacy=0x7fb58415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.761+0000 7fb57bfff640 1 -- 172.21.15.175:0/2883654603 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58415b2b0 con 0x7fb58406f1a0 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.762+0000 7fb57bfff640 1 --2- 172.21.15.175:0/2883654603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5840ce390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0097a0 tx=0x7fb56c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea291692b671402c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.762+0000 7fb581d9b640 1 -- 172.21.15.175:0/2883654603 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c034070 con 0x7fb58406f1a0 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.762+0000 7fb581d9b640 1 -- 172.21.15.175:0/2883654603 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56c030610 con 0x7fb58406f1a0 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.762+0000 7fb581d9b640 1 -- 172.21.15.175:0/2883654603 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0309e0 con 0x7fb58406f1a0 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 -- 172.21.15.175:0/2883654603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 msgr2=0x7fb5840ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 --2- 172.21.15.175:0/2883654603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5840ce390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb56c0097a0 tx=0x7fb56c02b960 comp rx=0 tx=0).stop 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 -- 172.21.15.175:0/2883654603 shutdown_connections 2024-04-14T10:57:40.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 --2- 172.21.15.175:0/2883654603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5840ce390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 -- 172.21.15.175:0/2883654603 >> 172.21.15.175:0/2883654603 conn(0x7fb584067db0 msgr2=0x7fb5840716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 -- 172.21.15.175:0/2883654603 shutdown_connections 2024-04-14T10:57:40.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.763+0000 7fb588f9c640 1 -- 172.21.15.175:0/2883654603 wait complete. 2024-04-14T10:57:40.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.764+0000 7fb588f9c640 1 Processor -- start 2024-04-14T10:57:40.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.764+0000 7fb588f9c640 1 -- start start 2024-04-14T10:57:40.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb588f9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5841f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb588f9c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5840ce8d0 0x7fb5840c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb588f9c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 0x7fb5840c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb588f9c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb58415bb50 con 0x7fb5840ce8d0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb588f9c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb58415b870 con 0x7fb58406f1a0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb588f9c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5841553d0 con 0x7fb584154ff0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb582d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 0x7fb5840c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb58259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5841f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb582d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 0x7fb5840c4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:54010/0 (socket says 172.21.15.175:54010) 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb582d9d640 1 -- 172.21.15.175:0/283875152 learned_addr learned my addr 172.21.15.175:0/283875152 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb57bfff640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5840ce8d0 0x7fb5840c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb58259c640 1 -- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 msgr2=0x7fb5840c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.765+0000 7fb58259c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 0x7fb5840c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb58259c640 1 -- 172.21.15.175:0/283875152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5840ce8d0 msgr2=0x7fb5840c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb58259c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5840ce8d0 0x7fb5840c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb58259c640 1 -- 172.21.15.175:0/283875152 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5841e5920 con 0x7fb58406f1a0 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb582d9d640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 0x7fb5840c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:40.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb58259c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5841f3fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c4a0 tx=0x7fb57400c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574017070 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb574005ce0 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5841f4ab0 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5740072d0 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5841e4f80 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb57401a070 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.766+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb57401cbc0 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.767+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb584069b20 con 0x7fb58406f1a0 2024-04-14T10:57:40.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.769+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb574007470 con 0x7fb58406f1a0 2024-04-14T10:57:40.787 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.787+0000 7f1a2c040040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T10:57:40.788 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.788+0000 7fd5641f1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T10:57:40.834 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:40.835+0000 7fd5641f1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T10:57:40.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.840+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8", "id": 4} v 0) -- 0x7fb584070480 con 0x7fb58406f1a0 2024-04-14T10:57:40.839 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.840+0000 7f1a2c040040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T10:57:40.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.845+0000 7fb57affd640 1 -- 172.21.15.175:0/283875152 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb574007650 con 0x7fb58406f1a0 2024-04-14T10:57:40.844 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 msgr2=0x7fb5841f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5841f3fd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c4a0 tx=0x7fb57400c960 comp rx=0 tx=0).stop 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 shutdown_connections 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb584154ff0 0x7fb5840c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5840ce8d0 0x7fb5840c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 --2- 172.21.15.175:0/283875152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb58406f1a0 0x7fb5841f3fd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 >> 172.21.15.175:0/283875152 conn(0x7fb584067db0 msgr2=0x7fb58415e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 shutdown_connections 2024-04-14T10:57:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.846+0000 7fb588f9c640 1 -- 172.21.15.175:0/283875152 wait complete. 2024-04-14T10:57:40.856 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 013406d6-5429-4687-9089-7fb92a8b293d 5 2024-04-14T10:57:40.889 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:40.890+0000 7f1a2c040040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T10:57:40.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.990+0000 7f1a074b7640 1 Processor -- start 2024-04-14T10:57:40.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.990+0000 7f1a074b7640 1 -- start start 2024-04-14T10:57:40.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a074b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a00151e20 0x7f1a001584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a074b7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1a0006b900 0x7f1a00072990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a074b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a00158a30 con 0x7f1a000c7120 2024-04-14T10:57:40.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a074b7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1a000c4970 con 0x7f1a0006b900 2024-04-14T10:57:40.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a074b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1a000735e0 con 0x7f1a00151e20 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05253640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a00151e20 0x7f1a001584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05a54640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1a000c7120 0x7f1a00072ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38928/0 (socket says 172.21.15.175:38928) 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05a54640 1 -- 172.21.15.175:0/882208589 learned_addr learned my addr 172.21.15.175:0/882208589 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a04a52640 1 --2- 172.21.15.175:0/882208589 >> v2:172.21.15.84:3300/0 conn(0x7f1a0006b900 0x7f1a00072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05253640 1 -- 172.21.15.175:0/882208589 >> v2:172.21.15.84:3300/0 conn(0x7f1a0006b900 msgr2=0x7f1a00072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05253640 1 --2- 172.21.15.175:0/882208589 >> v2:172.21.15.84:3300/0 conn(0x7f1a0006b900 0x7f1a00072990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05253640 1 -- 172.21.15.175:0/882208589 >> v1:172.21.15.175:6789/0 conn(0x7f1a000c7120 legacy=0x7f1a00072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f1a05253640 1 -- 172.21.15.175:0/882208589 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a000c4bc0 con 0x7f1a00151e20 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.991+0000 7f19f7fff640 1 -- 172.21.15.175:0/882208589 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173420098 0 0) 0x7f1a00158a30 con 0x7f1a000c7120 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.992+0000 7f1a05253640 1 --2- 172.21.15.175:0/882208589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a00151e20 0x7f1a001584f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1a000cac60 tx=0x7f19fc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a646df19d4a9419e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.992+0000 7f19f7fff640 1 -- 172.21.15.175:0/882208589 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc035020 con 0x7f1a00151e20 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.992+0000 7f19f7fff640 1 -- 172.21.15.175:0/882208589 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19fc031830 con 0x7f1a00151e20 2024-04-14T10:57:40.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.992+0000 7f19f7fff640 1 -- 172.21.15.175:0/882208589 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc031c00 con 0x7f1a00151e20 2024-04-14T10:57:40.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 -- 172.21.15.175:0/882208589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a00151e20 msgr2=0x7f1a001584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 --2- 172.21.15.175:0/882208589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a00151e20 0x7f1a001584f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1a000cac60 tx=0x7f19fc02b8d0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 -- 172.21.15.175:0/882208589 shutdown_connections 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 --2- 172.21.15.175:0/882208589 >> v2:172.21.15.84:3300/0 conn(0x7f1a0006b900 0x7f1a00072990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 --2- 172.21.15.175:0/882208589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a00151e20 0x7f1a001584f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 -- 172.21.15.175:0/882208589 >> 172.21.15.175:0/882208589 conn(0x7f1a000c9f70 msgr2=0x7f1a000ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 -- 172.21.15.175:0/882208589 shutdown_connections 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.993+0000 7f1a074b7640 1 -- 172.21.15.175:0/882208589 wait complete. 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 Processor -- start 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 -- start start 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 0x7f1a00158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a000c7120 0x7f1a0013e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a00151e20 0x7f1a0013eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00157fd0 con 0x7f1a00151e20 2024-04-14T10:57:40.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00157cf0 con 0x7f1a0006b900 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.994+0000 7f1a074b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1a00152200 con 0x7f1a000c7120 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 0x7f1a00158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 0x7f1a00158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51106/0 (socket says 172.21.15.175:51106) 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 -- 172.21.15.175:0/1338655417 learned_addr learned my addr 172.21.15.175:0/1338655417 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a04a52640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a000c7120 0x7f1a0013e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05a54640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a00151e20 0x7f1a0013eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 -- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a000c7120 msgr2=0x7f1a0013e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a000c7120 0x7f1a0013e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 -- 172.21.15.175:0/1338655417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a00151e20 msgr2=0x7f1a0013eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a00151e20 0x7f1a0013eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 -- 172.21.15.175:0/1338655417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0013dd50 con 0x7f1a0006b900 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a05253640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 0x7f1a00158eb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009890 tx=0x7f19fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc041070 con 0x7f1a0006b900 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19fc03a950 con 0x7f1a0006b900 2024-04-14T10:57:40.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0015b260 con 0x7f1a0006b900 2024-04-14T10:57:40.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc035040 con 0x7f1a0006b900 2024-04-14T10:57:40.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.995+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0015b820 con 0x7f1a0006b900 2024-04-14T10:57:40.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.996+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19fc038020 con 0x7f1a0006b900 2024-04-14T10:57:40.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.996+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f19fc045400 con 0x7f1a0006b900 2024-04-14T10:57:40.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.996+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a00069b20 con 0x7f1a0006b900 2024-04-14T10:57:40.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:40.998+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f19fc0317d0 con 0x7f1a0006b900 2024-04-14T10:57:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.071+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "013406d6-5429-4687-9089-7fb92a8b293d", "id": 5} v 0) -- 0x7f1a00073a70 con 0x7f1a0006b900 2024-04-14T10:57:41.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.076+0000 7f19f5ffb640 1 -- 172.21.15.175:0/1338655417 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "013406d6-5429-4687-9089-7fb92a8b293d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f19fc03ad40 con 0x7f1a0006b900 2024-04-14T10:57:41.076 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 msgr2=0x7f1a00158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 0x7f1a00158eb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009890 tx=0x7f19fc0046c0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 shutdown_connections 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1a00151e20 0x7f1a0013eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a000c7120 0x7f1a0013e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 --2- 172.21.15.175:0/1338655417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a0006b900 0x7f1a00158eb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 >> 172.21.15.175:0/1338655417 conn(0x7f1a000c9f70 msgr2=0x7f1a00072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 shutdown_connections 2024-04-14T10:57:41.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.077+0000 7f1a074b7640 1 -- 172.21.15.175:0/1338655417 wait complete. 2024-04-14T10:57:41.087 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 03dfbecf-9dbd-4da6-953c-72a37db7ec88 6 2024-04-14T10:57:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.189+0000 7ff306cc0640 1 Processor -- start 2024-04-14T10:57:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.189+0000 7ff306cc0640 1 -- start start 2024-04-14T10:57:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff306cc0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff30006c080 0x7ff30006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff306cc0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006c460 0x7ff300072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff306cc0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30006d1f0 con 0x7ff30006b900 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff306cc0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff30006cfb0 con 0x7ff30006c080 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff306cc0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff30015bc20 con 0x7ff30006c460 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2fffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006c460 0x7ff300072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff30525d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff30006b900 0x7ff3001548b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38930/0 (socket says 172.21.15.175:38930) 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff30525d640 1 -- 172.21.15.175:0/2201514122 learned_addr learned my addr 172.21.15.175:0/2201514122 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff304a5c640 1 --2- 172.21.15.175:0/2201514122 >> v2:172.21.15.84:3300/0 conn(0x7ff30006c080 0x7ff30006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2ff7fe640 1 -- 172.21.15.175:0/2201514122 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387554696 0 0) 0x7ff30006d1f0 con 0x7ff30006b900 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2ff7fe640 1 -- 172.21.15.175:0/2201514122 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f0003520 con 0x7ff30006b900 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2fffff640 1 -- 172.21.15.175:0/2201514122 >> v2:172.21.15.84:3300/0 conn(0x7ff30006c080 msgr2=0x7ff30006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2fffff640 1 --2- 172.21.15.175:0/2201514122 >> v2:172.21.15.84:3300/0 conn(0x7ff30006c080 0x7ff30006ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2fffff640 1 -- 172.21.15.175:0/2201514122 >> v1:172.21.15.175:6789/0 conn(0x7ff30006b900 legacy=0x7ff3001548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.190+0000 7ff2fffff640 1 -- 172.21.15.175:0/2201514122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30015b010 con 0x7ff30006c460 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.191+0000 7ff2fffff640 1 --2- 172.21.15.175:0/2201514122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006c460 0x7ff300072bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097a0 tx=0x7ff2ec02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=369fdc0497cca221 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.191+0000 7ff2ff7fe640 1 -- 172.21.15.175:0/2201514122 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec034070 con 0x7ff30006c460 2024-04-14T10:57:41.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.191+0000 7ff2ff7fe640 1 -- 172.21.15.175:0/2201514122 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ec030610 con 0x7ff30006c460 2024-04-14T10:57:41.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.191+0000 7ff2ff7fe640 1 -- 172.21.15.175:0/2201514122 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec0309e0 con 0x7ff30006c460 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 -- 172.21.15.175:0/2201514122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006c460 msgr2=0x7ff300072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2201514122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006c460 0x7ff300072bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec0097a0 tx=0x7ff2ec02b960 comp rx=0 tx=0).stop 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 -- 172.21.15.175:0/2201514122 shutdown_connections 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2201514122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006c460 0x7ff300072bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2201514122 >> v2:172.21.15.84:3300/0 conn(0x7ff30006c080 0x7ff30006ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 -- 172.21.15.175:0/2201514122 >> 172.21.15.175:0/2201514122 conn(0x7ff3000c9f70 msgr2=0x7ff3000ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 -- 172.21.15.175:0/2201514122 shutdown_connections 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.192+0000 7ff306cc0640 1 -- 172.21.15.175:0/2201514122 wait complete. 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.193+0000 7ff306cc0640 1 Processor -- start 2024-04-14T10:57:41.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.193+0000 7ff306cc0640 1 -- start start 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.193+0000 7ff306cc0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 0x7ff300152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.193+0000 7ff306cc0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff30006c080 0x7ff300150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff306cc0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30006c460 0x7ff3000c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff306cc0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff30015b8b0 con 0x7ff30006c080 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff306cc0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff30015b5d0 con 0x7ff30006c460 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff306cc0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff3000682d0 con 0x7ff30006b900 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff304a5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 0x7ff300152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30006c460 0x7ff3000c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff304a5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 0x7ff300152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:54028/0 (socket says 172.21.15.175:54028) 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff304a5c640 1 -- 172.21.15.175:0/2585376450 learned_addr learned my addr 172.21.15.175:0/2585376450 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff2fffff640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff30006c080 0x7ff300150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 -- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 msgr2=0x7ff300152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 0x7ff300152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 -- 172.21.15.175:0/2585376450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff30006c080 msgr2=0x7ff300150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff30006c080 0x7ff300150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 -- 172.21.15.175:0/2585376450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff300150c10 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff304a5c640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 0x7ff300152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff30525d640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30006c460 0x7ff3000c6750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800ca70 tx=0x7ff2f800cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8017070 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f800ab70 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8012400 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff300150ef0 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30015da90 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.194+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff2f801a070 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.195+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7ff2f801ccb0 con 0x7ff30006c460 2024-04-14T10:57:41.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.195+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300069b20 con 0x7ff30006c460 2024-04-14T10:57:41.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.197+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff2f801c6c0 con 0x7ff30006c460 2024-04-14T10:57:41.210 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.211+0000 7fd5641f1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T10:57:41.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.271+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "03dfbecf-9dbd-4da6-953c-72a37db7ec88", "id": 6} v 0) -- 0x7ff3000c88d0 con 0x7ff30006c460 2024-04-14T10:57:41.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.277+0000 7ff2fd7fa640 1 -- 172.21.15.175:0/2585376450 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03dfbecf-9dbd-4da6-953c-72a37db7ec88", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7ff2f801c970 con 0x7ff30006c460 2024-04-14T10:57:41.276 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-04-14T10:57:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.277+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30006c460 msgr2=0x7ff3000c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.277+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30006c460 0x7ff3000c6750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800ca70 tx=0x7ff2f800cf30 comp rx=0 tx=0).stop 2024-04-14T10:57:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 shutdown_connections 2024-04-14T10:57:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff30006c460 0x7ff3000c6750 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff30006c080 0x7ff300150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 --2- 172.21.15.175:0/2585376450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff30006b900 0x7ff300152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 >> 172.21.15.175:0/2585376450 conn(0x7ff3000c9f70 msgr2=0x7ff300159420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 shutdown_connections 2024-04-14T10:57:41.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.278+0000 7ff306cc0640 1 -- 172.21.15.175:0/2585376450 wait complete. 2024-04-14T10:57:41.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9aff0954-143c-4d74-97e3-5257ae629cf4 7 2024-04-14T10:57:41.292 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:41.293+0000 7f1a2c040040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T10:57:41.344 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.344+0000 7fd5641f1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T10:57:41.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.389+0000 7fd3f5de0640 1 Processor -- start 2024-04-14T10:57:41.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.389+0000 7fd3f5de0640 1 -- start start 2024-04-14T10:57:41.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3f5de0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3f00c6ee0 0x7fd3f00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3f5de0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 0x7fd3f006e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3f5de0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f00c72c0 con 0x7fd3f00ca450 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3f5de0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f00cb280 con 0x7fd3f00c6ee0 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3f5de0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f0158de0 con 0x7fd3f00ca000 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3ef7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3f00c6ee0 0x7fd3f00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3eeffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 0x7fd3f006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3ef7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3f00c6ee0 0x7fd3f00c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51114/0 (socket says 172.21.15.175:51114) 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3eeffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 0x7fd3f006e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:54036/0 (socket says 172.21.15.175:54036) 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3ef7fe640 1 -- 172.21.15.175:0/84172151 learned_addr learned my addr 172.21.15.175:0/84172151 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3eeffd640 1 -- 172.21.15.175:0/84172151 >> v2:172.21.15.175:3300/0 conn(0x7fd3f00c6ee0 msgr2=0x7fd3f00c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3eeffd640 1 --2- 172.21.15.175:0/84172151 >> v2:172.21.15.175:3300/0 conn(0x7fd3f00c6ee0 0x7fd3f00c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3eeffd640 1 -- 172.21.15.175:0/84172151 >> v1:172.21.15.84:6789/0 conn(0x7fd3f00ca450 legacy=0x7fd3f015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.390+0000 7fd3eeffd640 1 -- 172.21.15.175:0/84172151 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f01590c0 con 0x7fd3f00ca000 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.391+0000 7fd3eeffd640 1 --2- 172.21.15.175:0/84172151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 0x7fd3f006e270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40097a0 tx=0x7fd3e402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435d1d679ef7c21d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.391+0000 7fd3ee7fc640 1 -- 172.21.15.175:0/84172151 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4034070 con 0x7fd3f00ca000 2024-04-14T10:57:41.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.391+0000 7fd3ee7fc640 1 -- 172.21.15.175:0/84172151 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e4030610 con 0x7fd3f00ca000 2024-04-14T10:57:41.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.391+0000 7fd3ee7fc640 1 -- 172.21.15.175:0/84172151 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40309e0 con 0x7fd3f00ca000 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 -- 172.21.15.175:0/84172151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 msgr2=0x7fd3f006e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/84172151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 0x7fd3f006e270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40097a0 tx=0x7fd3e402b960 comp rx=0 tx=0).stop 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 -- 172.21.15.175:0/84172151 shutdown_connections 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/84172151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00ca000 0x7fd3f006e270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/84172151 >> v2:172.21.15.175:3300/0 conn(0x7fd3f00c6ee0 0x7fd3f00c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 -- 172.21.15.175:0/84172151 >> 172.21.15.175:0/84172151 conn(0x7fd3f00cd550 msgr2=0x7fd3f00c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 -- 172.21.15.175:0/84172151 shutdown_connections 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.392+0000 7fd3f5de0640 1 -- 172.21.15.175:0/84172151 wait complete. 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.393+0000 7fd3f5de0640 1 Processor -- start 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.393+0000 7fd3f5de0640 1 -- start start 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 0x7fd3f01f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3f00ca000 0x7fd3f014fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f00ca450 0x7fd3f0150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0159960 con 0x7fd3f00ca000 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0159680 con 0x7fd3f00ca450 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f0158a90 con 0x7fd3f00c6ee0 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3ef7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 0x7fd3f01f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f00ca450 0x7fd3f0150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3ef7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 0x7fd3f01f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:54040/0 (socket says 172.21.15.175:54040) 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3ef7fe640 1 -- 172.21.15.175:0/2928741205 learned_addr learned my addr 172.21.15.175:0/2928741205 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3eeffd640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3f00ca000 0x7fd3f014fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 -- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 msgr2=0x7fd3f01f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 0x7fd3f01f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 -- 172.21.15.175:0/2928741205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3f00ca000 msgr2=0x7fd3f014fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3f00ca000 0x7fd3f014fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 -- 172.21.15.175:0/2928741205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f01f2d00 con 0x7fd3f00ca450 2024-04-14T10:57:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3ef7fe640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 0x7fd3f01f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3effff640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f00ca450 0x7fd3f0150430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3f006f540 tx=0x7fd3e800cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8003b90 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e8003d50 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f0153420 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8005310 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.394+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f014f410 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.395+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3e80054b0 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.395+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd3e8012a80 con 0x7fd3f00ca450 2024-04-14T10:57:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.395+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f0069b20 con 0x7fd3f00ca450 2024-04-14T10:57:41.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.399+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd3e8012d20 con 0x7fd3f00ca450 2024-04-14T10:57:41.436 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:41.437+0000 7f1a2c040040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T10:57:41.464 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.464+0000 7fd5641f1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T10:57:41.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.472+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9aff0954-143c-4d74-97e3-5257ae629cf4", "id": 7} v 0) -- 0x7fd3f00cadc0 con 0x7fd3f00ca450 2024-04-14T10:57:41.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.478+0000 7fd3d7fff640 1 -- 172.21.15.175:0/2928741205 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9aff0954-143c-4d74-97e3-5257ae629cf4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd3e8012420 con 0x7fd3f00ca450 2024-04-14T10:57:41.478 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f00ca450 msgr2=0x7fd3f0150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f00ca450 0x7fd3f0150430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3f006f540 tx=0x7fd3e800cb90 comp rx=0 tx=0).stop 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 shutdown_connections 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3f00ca450 0x7fd3f0150430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3f00ca000 0x7fd3f014fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 --2- 172.21.15.175:0/2928741205 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3f00c6ee0 0x7fd3f01f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 >> 172.21.15.175:0/2928741205 conn(0x7fd3f00cd550 msgr2=0x7fd3f00c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 shutdown_connections 2024-04-14T10:57:41.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-14T10:57:41.479+0000 7fd3f5de0640 1 -- 172.21.15.175:0/2928741205 wait complete. 2024-04-14T10:57:41.489 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-14T10:57:41.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-14T10:57:41.492 INFO:tasks.ceph.osd.0:Started 2024-04-14T10:57:41.492 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-14T10:57:41.492 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-14T10:57:41.494 INFO:tasks.ceph.osd.1:Started 2024-04-14T10:57:41.494 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-14T10:57:41.494 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-14T10:57:41.497 INFO:tasks.ceph.osd.2:Started 2024-04-14T10:57:41.497 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-14T10:57:41.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-14T10:57:41.499 INFO:tasks.ceph.osd.3:Started 2024-04-14T10:57:41.500 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-14T10:57:41.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-14T10:57:41.515 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.515+0000 7fd5641f1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T10:57:41.532 INFO:tasks.ceph.osd.4:Started 2024-04-14T10:57:41.532 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-14T10:57:41.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-14T10:57:41.534 INFO:tasks.ceph.osd.5:Started 2024-04-14T10:57:41.534 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-14T10:57:41.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-14T10:57:41.536 INFO:tasks.ceph.osd.6:Started 2024-04-14T10:57:41.536 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-14T10:57:41.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-14T10:57:41.539 INFO:tasks.ceph.osd.7:Started 2024-04-14T10:57:41.539 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:57:41.569 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:41.570+0000 7f1a2c040040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T10:57:41.637 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:41.638+0000 7f1a2c040040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T10:57:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.656+0000 7fba73cb7640 1 Processor -- start 2024-04-14T10:57:41.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba73cb7640 1 -- start start 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba73cb7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba6c152d60 0x7fba6c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba73cb7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c15d000 con 0x7fba6c0b42d0 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba73cb7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba6c0c3ad0 con 0x7fba6c0c44d0 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba73cb7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fba6c071070 con 0x7fba6c152d60 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba71a53640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fba6c152d60 0x7fba6c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.657+0000 7fba71252640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fba6c0b42d0 0x7fba6c0c3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53292/0 (socket says 172.21.15.84:53292) 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.658+0000 7fba71252640 1 -- 172.21.15.84:0/394696470 learned_addr learned my addr 172.21.15.84:0/394696470 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:57:41.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.658+0000 7fba71a53640 1 -- 172.21.15.84:0/394696470 >> v1:172.21.15.175:6789/0 conn(0x7fba6c0c44d0 legacy=0x7fba6c06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.658+0000 7fba71a53640 1 -- 172.21.15.84:0/394696470 >> v1:172.21.15.84:6789/0 conn(0x7fba6c0b42d0 legacy=0x7fba6c0c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.658+0000 7fba71a53640 1 -- 172.21.15.84:0/394696470 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0c8e90 con 0x7fba6c152d60 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.658+0000 7fba70a51640 1 -- 172.21.15.84:0/394696470 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118496844 0 0) 0x7fba6c15d000 con 0x7fba6c0b42d0 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba71a53640 1 --2- 172.21.15.84:0/394696470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c152d60 0x7fba6c15cac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba680097a0 tx=0x7fba6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a683d5639abf36 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba70a51640 1 -- 172.21.15.84:0/394696470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68035020 con 0x7fba6c152d60 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba70a51640 1 -- 172.21.15.84:0/394696470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba68031830 con 0x7fba6c152d60 2024-04-14T10:57:41.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba70a51640 1 -- 172.21.15.84:0/394696470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba68031c00 con 0x7fba6c152d60 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 -- 172.21.15.84:0/394696470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c152d60 msgr2=0x7fba6c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 --2- 172.21.15.84:0/394696470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c152d60 0x7fba6c15cac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba680097a0 tx=0x7fba6802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 -- 172.21.15.84:0/394696470 shutdown_connections 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 --2- 172.21.15.84:0/394696470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c152d60 0x7fba6c15cac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 -- 172.21.15.84:0/394696470 >> 172.21.15.84:0/394696470 conn(0x7fba6c071590 msgr2=0x7fba6c071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 -- 172.21.15.84:0/394696470 shutdown_connections 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.659+0000 7fba73cb7640 1 -- 172.21.15.84:0/394696470 wait complete. 2024-04-14T10:57:41.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.660+0000 7fba73cb7640 1 Processor -- start 2024-04-14T10:57:41.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.660+0000 7fba73cb7640 1 -- start start 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba73cb7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c0b42d0 0x7fba6c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba73cb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c152d60 0x7fba6c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba73cb7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 0x7fba6c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba73cb7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c06f900 con 0x7fba6c0c5f50 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba73cb7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba6c0c3550 con 0x7fba6c0b42d0 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba73cb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba6c0c37f0 con 0x7fba6c152d60 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba72254640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 0x7fba6c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba72254640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 0x7fba6c0c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56540/0 (socket says 172.21.15.84:56540) 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba72254640 1 -- 172.21.15.84:0/154476498 learned_addr learned my addr 172.21.15.84:0/154476498 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.661+0000 7fba71a53640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c0b42d0 0x7fba6c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba72254640 1 -- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c152d60 msgr2=0x7fba6c157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba72254640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c152d60 0x7fba6c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba72254640 1 -- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c0b42d0 msgr2=0x7fba6c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba72254640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c0b42d0 0x7fba6c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba72254640 1 -- 172.21.15.84:0/154476498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba6c0cc370 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba72254640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 0x7fba6c0c6400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c790 tx=0x7fba6400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba64003b70 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba64003d10 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba6400aa90 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba6c157c90 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba6c158210 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba6400ac30 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.662+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fba64012c30 con 0x7fba6c0c5f50 2024-04-14T10:57:41.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.663+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba6c069c30 con 0x7fba6c0c5f50 2024-04-14T10:57:41.665 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.663+0000 7fd5641f1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:57:41.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.665+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fba6c0cc370 con 0x7fba6c0c5f50 2024-04-14T10:57:41.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.726+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba6c0c9670 con 0x7fba6c0c5f50 2024-04-14T10:57:41.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.726+0000 7fba5e7fc640 1 -- 172.21.15.84:0/154476498 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fba64012560 con 0x7fba6c0c5f50 2024-04-14T10:57:41.726 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:41.726 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":10,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:57:41.474103+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:57:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 msgr2=0x7fba6c0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 0x7fba6c0c6400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c790 tx=0x7fba6400cc50 comp rx=0 tx=0).stop 2024-04-14T10:57:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 shutdown_connections 2024-04-14T10:57:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fba6c0c5f50 0x7fba6c0c6400 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba6c152d60 0x7fba6c157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 --2- 172.21.15.84:0/154476498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba6c0b42d0 0x7fba6c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:41.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 >> 172.21.15.84:0/154476498 conn(0x7fba6c071590 msgr2=0x7fba6c153470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:41.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 shutdown_connections 2024-04-14T10:57:41.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:41.727+0000 7fba73cb7640 1 -- 172.21.15.84:0/154476498 wait complete. 2024-04-14T10:57:41.737 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-14T10:57:41.738 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-14T10:57:41.752 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:41.752+0000 7f1a2c040040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:57:41.763 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.763+0000 7fd5641f1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T10:57:41.847 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:41.847+0000 7f1a2c040040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T10:57:41.920 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.921+0000 7fd5641f1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:57:41.962 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:41.962+0000 7fd5641f1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T10:57:42.003 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:42.003+0000 7f1a2c040040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:57:42.045 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:42.046+0000 7f1a2c040040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T10:57:42.105 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T10:57:42.105+0000 7f4f31e1a640 -1 Falling back to public interface 2024-04-14T10:57:42.105 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T10:57:42.106+0000 7fe132d49640 -1 Falling back to public interface 2024-04-14T10:57:42.106 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T10:57:42.107+0000 7f565e248640 -1 Falling back to public interface 2024-04-14T10:57:42.120 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:42.120+0000 7fd5641f1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T10:57:42.131 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T10:57:42.131+0000 7fee65f21640 -1 Falling back to public interface 2024-04-14T10:57:42.131 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T10:57:42.131+0000 7f663ea0c640 -1 Falling back to public interface 2024-04-14T10:57:42.131 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T10:57:42.131+0000 7f663cffd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-14T10:57:42.131 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T10:57:42.131+0000 7fee64bfd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-04-14T10:57:42.132 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T10:57:42.132+0000 7f5d362b5640 -1 Falling back to public interface 2024-04-14T10:57:42.134 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T10:57:42.135+0000 7f306a40e640 -1 Falling back to public interface 2024-04-14T10:57:42.150 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T10:57:42.151+0000 7f1c23b06640 -1 Falling back to public interface 2024-04-14T10:57:42.209 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:42.207+0000 7f1a2c040040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T10:57:42.543 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T10:57:42.632 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.633+0000 7f35f85aa640 1 Processor -- start 2024-04-14T10:57:42.633 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.633+0000 7f35f85aa640 1 -- start start 2024-04-14T10:57:42.635 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f85aa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f35f01552b0 0x7f35f00d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:42.635 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f85aa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35f00cc810 0x7f35f015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f85aa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f00c5c70 con 0x7f35f00d0b90 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f85aa640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f35f00c5e80 con 0x7f35f00cc810 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f85aa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f35f00c6ce0 con 0x7f35f01552b0 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35f00cc810 0x7f35f015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f35f00cc810 0x7f35f015e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39228/0 (socket says 172.21.15.84:39228) 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 -- 172.21.15.84:0/3212500530 learned_addr learned my addr 172.21.15.84:0/3212500530 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:42.636 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6346640 1 --2- 172.21.15.84:0/3212500530 >> v2:172.21.15.175:3300/0 conn(0x7f35f01552b0 0x7f35f00d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 -- 172.21.15.84:0/3212500530 >> v2:172.21.15.175:3300/0 conn(0x7f35f01552b0 msgr2=0x7f35f00d0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 --2- 172.21.15.84:0/3212500530 >> v2:172.21.15.175:3300/0 conn(0x7f35f01552b0 0x7f35f00d0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 -- 172.21.15.84:0/3212500530 >> v1:172.21.15.175:6789/0 conn(0x7f35f00d0b90 legacy=0x7f35f00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6b47640 1 -- 172.21.15.84:0/3212500530 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f00c60d0 con 0x7f35f00cc810 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.634+0000 7f35f6346640 1 --2- 172.21.15.84:0/3212500530 >> v2:172.21.15.175:3300/0 conn(0x7f35f01552b0 0x7f35f00d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f6b47640 1 --2- 172.21.15.84:0/3212500530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f015e5a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35f00d14d0 tx=0x7f35e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457f2d802b0cf4e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f5344640 1 -- 172.21.15.84:0/3212500530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e802cb20 con 0x7f35f00cc810 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f5344640 1 -- 172.21.15.84:0/3212500530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e802ccc0 con 0x7f35f00cc810 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f5344640 1 -- 172.21.15.84:0/3212500530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8034610 con 0x7f35f00cc810 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f85aa640 1 -- 172.21.15.84:0/3212500530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 msgr2=0x7f35f015e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f85aa640 1 --2- 172.21.15.84:0/3212500530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f015e5a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f35f00d14d0 tx=0x7f35e802bf80 comp rx=0 tx=0).stop 2024-04-14T10:57:42.637 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f85aa640 1 -- 172.21.15.84:0/3212500530 shutdown_connections 2024-04-14T10:57:42.638 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f85aa640 1 --2- 172.21.15.84:0/3212500530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f015e5a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.638 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.635+0000 7f35f85aa640 1 --2- 172.21.15.84:0/3212500530 >> v2:172.21.15.175:3300/0 conn(0x7f35f01552b0 0x7f35f00d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.638 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.636+0000 7f35f85aa640 1 -- 172.21.15.84:0/3212500530 >> 172.21.15.84:0/3212500530 conn(0x7f35f0062400 msgr2=0x7f35f0062810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:42.638 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.636+0000 7f35f85aa640 1 -- 172.21.15.84:0/3212500530 shutdown_connections 2024-04-14T10:57:42.638 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.636+0000 7f35f85aa640 1 -- 172.21.15.84:0/3212500530 wait complete. 2024-04-14T10:57:42.641 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 Processor -- start 2024-04-14T10:57:42.641 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 -- start start 2024-04-14T10:57:42.641 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f0149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:42.641 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35f00d0b90 0x7f35f0152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f01552b0 0x7f35f0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f35f00c6970 con 0x7f35f00cc810 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35f00c6690 con 0x7f35f01552b0 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f85aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35f00cc3e0 con 0x7f35f00d0b90 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f6346640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f0149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f6346640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f0149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39230/0 (socket says 172.21.15.84:39230) 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f6346640 1 -- 172.21.15.84:0/2051064083 learned_addr learned my addr 172.21.15.84:0/2051064083 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f6b47640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f01552b0 0x7f35f0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.637+0000 7f35f5b45640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35f00d0b90 0x7f35f0152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f6346640 1 -- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35f00d0b90 msgr2=0x7f35f0152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f6346640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35f00d0b90 0x7f35f0152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f6346640 1 -- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f01552b0 msgr2=0x7f35f0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:42.642 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f6346640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f01552b0 0x7f35f0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f6346640 1 -- 172.21.15.84:0/2051064083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01f12e0 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f5b45640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35f00d0b90 0x7f35f0152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f6346640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f0149460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00e810 tx=0x7f35ec00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00f040 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec004030 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f01f15a0 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec004400 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f0151a40 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35ec00ca60 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.638+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f35ec013b80 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.639+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f00694a0 con 0x7f35f00cc810 2024-04-14T10:57:42.643 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.641+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f35ec017020 con 0x7f35f00cc810 2024-04-14T10:57:42.703 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.703+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35f00cbab0 con 0x7f35f00cc810 2024-04-14T10:57:42.703 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.704+0000 7f35e6ffd640 1 -- 172.21.15.84:0/2051064083 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f35ec0134b0 con 0x7f35f00cc810 2024-04-14T10:57:42.703 INFO:teuthology.misc.health.smithi084.stdout: 2024-04-14T10:57:42.704 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":10,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:57:41.474103+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:57:42.704 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 msgr2=0x7f35f0149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f0149460 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00e810 tx=0x7f35ec00ecd0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 shutdown_connections 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35f01552b0 0x7f35f0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35f00d0b90 0x7f35f0152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 --2- 172.21.15.84:0/2051064083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f35f00cc810 0x7f35f0149460 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 >> 172.21.15.84:0/2051064083 conn(0x7f35f0062400 msgr2=0x7f35f00627e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 shutdown_connections 2024-04-14T10:57:42.705 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:42.705+0000 7f35f85aa640 1 -- 172.21.15.84:0/2051064083 wait complete. 2024-04-14T10:57:42.713 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T10:57:42.943 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:42.944+0000 7fd5641f1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T10:57:43.019 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:43.020+0000 7f1a2c040040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T10:57:43.221 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:43.222+0000 7fd5641f1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T10:57:43.275 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:43.276+0000 7fd5641f1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T10:57:43.297 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:43.297+0000 7f1a2c040040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T10:57:43.348 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:43.349+0000 7f1a2c040040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T10:57:43.390 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:43.390+0000 7fd5641f1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T10:57:43.469 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-14T10:57:43.469+0000 7f1a2c040040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T10:57:44.404 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:44.405+0000 7fd505410640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-14T10:57:44.405 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T10:57:44.405+0000 7fd505410640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-14T10:57:45.574 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T10:57:45.575+0000 7f4f31e1a640 -1 osd.3 0 log_to_monitors true 2024-04-14T10:57:45.607 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T10:57:45.608+0000 7f663ea0c640 -1 osd.6 0 log_to_monitors true 2024-04-14T10:57:45.611 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T10:57:45.611+0000 7fee65f21640 -1 osd.7 0 log_to_monitors true 2024-04-14T10:57:45.629 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T10:57:45.630+0000 7fe132d49640 -1 osd.0 0 log_to_monitors true 2024-04-14T10:57:45.636 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T10:57:45.637+0000 7f565e248640 -1 osd.1 0 log_to_monitors true 2024-04-14T10:57:45.647 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T10:57:45.648+0000 7f5d362b5640 -1 osd.2 0 log_to_monitors true 2024-04-14T10:57:45.664 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T10:57:45.665+0000 7f306a40e640 -1 osd.4 0 log_to_monitors true 2024-04-14T10:57:45.665 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T10:57:45.666+0000 7f1c23b06640 -1 osd.5 0 log_to_monitors true 2024-04-14T10:57:49.425 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T10:57:49.425+0000 7f6639ff7640 -1 osd.6 0 waiting for initial osdmap 2024-04-14T10:57:49.437 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T10:57:49.438+0000 7f6631e80640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.481 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T10:57:49.482+0000 7f1c1f7f7640 -1 osd.5 0 waiting for initial osdmap 2024-04-14T10:57:49.494 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T10:57:49.495+0000 7f1c17680640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.501 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T10:57:49.501+0000 7f5d31ff7640 -1 osd.2 0 waiting for initial osdmap 2024-04-14T10:57:49.510 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T10:57:49.510+0000 7f4f2d3f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-14T10:57:49.512 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T10:57:49.513+0000 7f5d29e28640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.518 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T10:57:49.519+0000 7f4f25280640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.520 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T10:57:49.528 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T10:57:49.528+0000 7f30659f7640 -1 osd.4 0 waiting for initial osdmap 2024-04-14T10:57:49.528 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T10:57:49.529+0000 7fee61bf7640 -1 osd.7 0 waiting for initial osdmap 2024-04-14T10:57:49.532 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T10:57:49.533+0000 7fe12e9f7640 -1 osd.0 0 waiting for initial osdmap 2024-04-14T10:57:49.539 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T10:57:49.540+0000 7f5659fd8640 -1 osd.1 0 waiting for initial osdmap 2024-04-14T10:57:49.544 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T10:57:49.545+0000 7f305d880640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.546 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T10:57:49.547+0000 7fe126880640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.548 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T10:57:49.549+0000 7fee59a80640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.553 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T10:57:49.554+0000 7f5651df8640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:57:49.614 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.614+0000 7f91cf91e640 1 Processor -- start 2024-04-14T10:57:49.614 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cf91e640 1 -- start start 2024-04-14T10:57:49.622 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cf91e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91c80c4190 0x7f91c8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.622 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cf91e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c80caa40 con 0x7f91c80c93f0 2024-04-14T10:57:49.622 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cf91e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c815cfb0 con 0x7f91c80c97d0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cf91e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f91c8159770 con 0x7f91c80c4190 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cd6ba640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91c80c93f0 0x7f91c80ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53674/0 (socket says 172.21.15.84:53674) 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.615+0000 7f91cd6ba640 1 -- 172.21.15.84:0/758225042 learned_addr learned my addr 172.21.15.84:0/758225042 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cceb9640 1 --2- 172.21.15.84:0/758225042 >> v2:172.21.15.175:3300/0 conn(0x7f91c80c4190 0x7f91c8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627816710 0 0) 0x7f91c80caa40 con 0x7f91c80c93f0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91b4003520 con 0x7f91c80c93f0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1262863146 0 0) 0x7f91b4003520 con 0x7f91c80c93f0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 >> v2:172.21.15.175:3300/0 conn(0x7f91c80c4190 msgr2=0x7f91c8152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 --2- 172.21.15.84:0/758225042 >> v2:172.21.15.175:3300/0 conn(0x7f91c80c4190 0x7f91c8152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 >> v1:172.21.15.175:6789/0 conn(0x7f91c80c97d0 legacy=0x7f91c815c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c815d250 con 0x7f91c80c93f0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7f91c00019f0 con 0x7f91c80c93f0 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 >> v1:172.21.15.84:6789/0 conn(0x7f91c80c93f0 legacy=0x7f91c80ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.623 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91b4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b4004800 0x7f91b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91b40051c0 0x7f91b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8159770 con 0x7f91b40039b0 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91b400c090 con 0x7f91b4004800 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91b400c290 con 0x7f91b40051c0 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91b4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cceb9640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b4004800 0x7f91b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cdebb640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91b40051c0 0x7f91b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cd6ba640 1 -- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91b40051c0 msgr2=0x7f91b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91b40051c0 0x7f91b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cd6ba640 1 -- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b4004800 msgr2=0x7f91b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91b4004800 0x7f91b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cd6ba640 1 -- 172.21.15.84:0/758225042 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b4003520 con 0x7f91b40039b0 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.616+0000 7f91cdebb640 1 -- 172.21.15.84:0/758225042 reap_dead start 2024-04-14T10:57:49.624 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.617+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91b4003df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91c000a840 tx=0x7f91b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916b4a407004d8da server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.617+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c000a470 con 0x7f91b40039b0 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.617+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c00072d0 con 0x7f91b40039b0 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.617+0000 7f91bffff640 1 -- 172.21.15.84:0/758225042 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c00076e0 con 0x7f91b40039b0 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 -- 172.21.15.84:0/758225042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 msgr2=0x7f91b4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91b4003df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91c000a840 tx=0x7f91b4005830 comp rx=0 tx=0).stop 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 -- 172.21.15.84:0/758225042 shutdown_connections 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 --2- 172.21.15.84:0/758225042 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91b4003df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 -- 172.21.15.84:0/758225042 >> 172.21.15.84:0/758225042 conn(0x7f91c80718d0 msgr2=0x7f91c8071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 -- 172.21.15.84:0/758225042 shutdown_connections 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.618+0000 7f91cf91e640 1 -- 172.21.15.84:0/758225042 wait complete. 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.619+0000 7f91cf91e640 1 Processor -- start 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.619+0000 7f91cf91e640 1 -- start start 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91c8143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.625 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c81f4680 0x7f91c81f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80b2890 0x7f91c81484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8159400 con 0x7f91b40039b0 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8159120 con 0x7f91c81f4680 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91c8159c00 con 0x7f91c80b2890 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91c8143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91c8143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39362/0 (socket says 172.21.15.84:39362) 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 -- 172.21.15.84:0/1911124375 learned_addr learned my addr 172.21.15.84:0/1911124375 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cceb9640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c81f4680 0x7f91c81f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cdebb640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80b2890 0x7f91c81484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 -- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80b2890 msgr2=0x7f91c81484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80b2890 0x7f91c81484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 -- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c81f4680 msgr2=0x7f91c81f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c81f4680 0x7f91c81f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.626 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 -- 172.21.15.84:0/1911124375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8158a10 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cd6ba640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91c8143590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91c000a960 tx=0x7f91c80c3d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0039040 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0043070 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c8143ad0 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c000a470 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.620+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81f3e80 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.621+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c806c920 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.622+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f91c00072d0 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.622+0000 7f91bdffb640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91ac06c860 0x7f91ac06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.622+0000 7f91cceb9640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91ac06c860 0x7f91ac06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.622+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f91c00ac7e0 con 0x7f91b40039b0 2024-04-14T10:57:49.627 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.623+0000 7f91cceb9640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91ac06c860 0x7f91ac06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f91c8148fd0 tx=0x7f91b8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:49.628 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.627+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f91c004c020 con 0x7f91b40039b0 2024-04-14T10:57:49.801 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.802+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c81f3990 con 0x7f91b40039b0 2024-04-14T10:57:49.802 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.803+0000 7f91bdffb640 1 -- 172.21.15.84:0/1911124375 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f91c007ba90 con 0x7f91b40039b0 2024-04-14T10:57:49.802 INFO:teuthology.misc.health.smithi084.stdout: 2024-04-14T10:57:49.802 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":12,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:57:47.406260+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:57:49.804 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91ac06c860 msgr2=0x7f91ac06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.804 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91ac06c860 0x7f91ac06ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f91c8148fd0 tx=0x7f91b8008040 comp rx=0 tx=0).stop 2024-04-14T10:57:49.804 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 msgr2=0x7f91c8143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91c8143590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f91c000a960 tx=0x7f91c80c3d60 comp rx=0 tx=0).stop 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 shutdown_connections 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91ac06c860 0x7f91ac06ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80b2890 0x7f91c81484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c81f4680 0x7f91c81f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 --2- 172.21.15.84:0/1911124375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91b40039b0 0x7f91c8143590 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 >> 172.21.15.84:0/1911124375 conn(0x7f91c80718d0 msgr2=0x7f91c8151bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 shutdown_connections 2024-04-14T10:57:49.805 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:49.805+0000 7f91cf91e640 1 -- 172.21.15.84:0/1911124375 wait complete. 2024-04-14T10:57:49.813 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T10:57:56.621 DEBUG:teuthology.orchestra.run.smithi084:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T10:57:56.721 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.722+0000 7fa6574c8640 1 Processor -- start 2024-04-14T10:57:56.722 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa6574c8640 1 -- start start 2024-04-14T10:57:56.725 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa6574c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa6500cd570 0x7fa6500cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa6574c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 0x7fa6500733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa6574c8640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa65015b380 con 0x7fa650155100 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa6574c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa6500c7ee0 con 0x7fa6500cd570 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa6574c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa6500c9f90 con 0x7fa650072f90 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa655264640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa650155100 0x7fa6500ca6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39214/0 (socket says 172.21.15.84:39214) 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.723+0000 7fa655264640 1 -- 172.21.15.84:0/2730761342 learned_addr learned my addr 172.21.15.84:0/2730761342 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa654a63640 1 --2- 172.21.15.84:0/2730761342 >> v2:172.21.15.175:3300/0 conn(0x7fa6500cd570 0x7fa6500cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa655a65640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 0x7fa6500733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059306333 0 0) 0x7fa65015b380 con 0x7fa650155100 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa63c003520 con 0x7fa650155100 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 81251957 0 0) 0x7fa63c003520 con 0x7fa650155100 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 msgr2=0x7fa6500733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 0x7fa6500733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.726 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 >> v2:172.21.15.175:3300/0 conn(0x7fa6500cd570 msgr2=0x7fa6500cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 --2- 172.21.15.84:0/2730761342 >> v2:172.21.15.175:3300/0 conn(0x7fa6500cd570 0x7fa6500cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500ca1d0 con 0x7fa650155100 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7fa64c001a10 con 0x7fa650155100 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 >> v1:172.21.15.84:6789/0 conn(0x7fa650155100 legacy=0x7fa6500ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c0039b0 0x7fa63c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 0x7fa63c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa63c004d40 0x7fa63c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6500c9f90 con 0x7fa63c0039b0 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c00b9c0 con 0x7fa63c004d40 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa63c00bb40 con 0x7fa650072f90 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa655264640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c0039b0 0x7fa63c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa654a63640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 0x7fa63c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.724+0000 7fa655a65640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa63c004d40 0x7fa63c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa655264640 1 -- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 msgr2=0x7fa63c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:56.727 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa655264640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa650072f90 0x7fa63c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa655264640 1 -- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa63c004d40 msgr2=0x7fa63c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa655264640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa63c004d40 0x7fa63c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa655264640 1 -- 172.21.15.84:0/2730761342 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c003520 con 0x7fa63c0039b0 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa655264640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c0039b0 0x7fa63c003dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00a890 tx=0x7fa63c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59c789a30f505b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00a4e0 con 0x7fa63c0039b0 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64c0072f0 con 0x7fa63c0039b0 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.725+0000 7fa647fff640 1 -- 172.21.15.84:0/2730761342 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0076e0 con 0x7fa63c0039b0 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa6574c8640 1 -- 172.21.15.84:0/2730761342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c0039b0 msgr2=0x7fa63c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa6574c8640 1 --2- 172.21.15.84:0/2730761342 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa63c0039b0 0x7fa63c003dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00a890 tx=0x7fa63c005830 comp rx=0 tx=0).stop 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa655a65640 1 -- 172.21.15.84:0/2730761342 reap_dead start 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa6574c8640 1 -- 172.21.15.84:0/2730761342 shutdown_connections 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa6574c8640 1 -- 172.21.15.84:0/2730761342 >> 172.21.15.84:0/2730761342 conn(0x7fa65006ecd0 msgr2=0x7fa65006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa6574c8640 1 -- 172.21.15.84:0/2730761342 shutdown_connections 2024-04-14T10:57:56.728 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.726+0000 7fa6574c8640 1 -- 172.21.15.84:0/2730761342 wait complete. 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.727+0000 7fa6574c8640 1 Processor -- start 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.727+0000 7fa6574c8640 1 -- start start 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa6574c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa63c0039b0 0x7fa6501f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa6574c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 0x7fa65014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa6574c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa65014ef70 0x7fa65014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa6574c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa65015b900 con 0x7fa65015ee80 2024-04-14T10:57:56.731 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa6574c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa65015bec0 con 0x7fa65014ef70 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa6574c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa65015bbe0 con 0x7fa63c0039b0 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 0x7fa65014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 0x7fa65014ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53906/0 (socket says 172.21.15.84:53906) 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 -- 172.21.15.84:0/3759270007 learned_addr learned my addr 172.21.15.84:0/3759270007 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa655264640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa63c0039b0 0x7fa6501f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 -- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa63c0039b0 msgr2=0x7fa6501f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa655a65640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa65014ef70 0x7fa65014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa63c0039b0 0x7fa6501f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 -- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa65014ef70 msgr2=0x7fa65014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa65014ef70 0x7fa65014f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.728+0000 7fa654a63640 1 -- 172.21.15.84:0/3759270007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65014d3a0 con 0x7fa65015ee80 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.729+0000 7fa654a63640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 0x7fa65014ce60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa640011a70 tx=0x7fa640011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.729+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64000fb50 con 0x7fa65015ee80 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.729+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64000fcf0 con 0x7fa65015ee80 2024-04-14T10:57:56.732 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.729+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64000fea0 con 0x7fa65015ee80 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.729+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6501560d0 con 0x7fa65015ee80 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.729+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa650156650 con 0x7fa65015ee80 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.730+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6500c6f10 con 0x7fa65015ee80 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.730+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa640012040 con 0x7fa65015ee80 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.731+0000 7fa645ffb640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa63406c920 0x7fa63406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.731+0000 7fa655264640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa63406c920 0x7fa63406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.731+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa64008be70 con 0x7fa65015ee80 2024-04-14T10:57:56.733 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.731+0000 7fa655264640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa63406c920 0x7fa63406ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa64c034000 tx=0x7fa64c007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:56.734 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.736+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fa6500c6f10 con 0x7fa65015ee80 2024-04-14T10:57:56.911 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.912+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6500cd210 con 0x7fa65015ee80 2024-04-14T10:57:56.911 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.912+0000 7fa645ffb640 1 -- 172.21.15.84:0/3759270007 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7fa6500cd210 con 0x7fa65015ee80 2024-04-14T10:57:56.912 INFO:teuthology.misc.health.smithi084.stdout: 2024-04-14T10:57:56.912 INFO:teuthology.misc.health.smithi084.stdout:{"epoch":16,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:57:53.552116+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:57:56.914 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.914+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa63406c920 msgr2=0x7fa63406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:56.914 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.914+0000 7fa6574c8640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa63406c920 0x7fa63406ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa64c034000 tx=0x7fa64c007000 comp rx=0 tx=0).stop 2024-04-14T10:57:56.914 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.914+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 msgr2=0x7fa65014ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:56.914 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.914+0000 7fa6574c8640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 0x7fa65014ce60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa640011a70 tx=0x7fa640011f30 comp rx=0 tx=0).stop 2024-04-14T10:57:56.914 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 shutdown_connections 2024-04-14T10:57:56.914 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa63406c920 0x7fa63406ede0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.915 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa65014ef70 0x7fa65014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.915 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa65015ee80 0x7fa65014ce60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.915 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 --2- 172.21.15.84:0/3759270007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa63c0039b0 0x7fa6501f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:56.915 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 >> 172.21.15.84:0/3759270007 conn(0x7fa65006ecd0 msgr2=0x7fa6500c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:56.915 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 shutdown_connections 2024-04-14T10:57:56.915 INFO:teuthology.misc.health.smithi084.stderr:2024-04-14T10:57:56.915+0000 7fa6574c8640 1 -- 172.21.15.84:0/3759270007 wait complete. 2024-04-14T10:57:56.924 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-14T10:57:56.924 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-14T10:57:56.924 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T10:57:56.924 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T10:57:56.926 INFO:tasks.ceph.mds.a:Started 2024-04-14T10:57:56.926 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T10:57:56.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T10:57:56.928 INFO:tasks.ceph.mds.c:Started 2024-04-14T10:57:56.928 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-14T10:57:56.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-14T10:57:56.931 INFO:tasks.ceph.mds.e:Started 2024-04-14T10:57:56.932 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T10:57:56.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T10:57:56.935 INFO:tasks.ceph.mds.b:Started 2024-04-14T10:57:56.935 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-14T10:57:56.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-14T10:57:56.937 INFO:tasks.ceph.mds.d:Started 2024-04-14T10:57:56.937 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-14T10:57:56.937 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-14T10:57:56.939 INFO:tasks.ceph.mds.f:Started 2024-04-14T10:57:56.940 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-14T10:57:56.940 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:57:57.005 INFO:tasks.ceph.mds.c.smithi084.stdout:starting mds.c at 2024-04-14T10:57:57.005 INFO:tasks.ceph.mds.a.smithi084.stdout:starting mds.a at 2024-04-14T10:57:57.008 INFO:tasks.ceph.mds.e.smithi084.stdout:starting mds.e at 2024-04-14T10:57:57.026 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-14T10:57:57.027 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-14T10:57:57.028 INFO:tasks.ceph.mds.f.smithi175.stdout:starting mds.f at 2024-04-14T10:57:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.048+0000 7f3ca9a60640 1 Processor -- start 2024-04-14T10:57:57.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.048+0000 7f3ca9a60640 1 -- start start 2024-04-14T10:57:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca9a60640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ca4155160 0x7f3ca40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca9a60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca415b6d0 0x7f3ca40cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca9a60640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca40ccd90 con 0x7f3ca40b3930 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca9a60640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca415e4d0 con 0x7f3ca4155160 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca9a60640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca415e7b0 con 0x7f3ca415b6d0 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ca4155160 0x7f3ca40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3ca4155160 0x7f3ca40cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53964/0 (socket says 172.21.15.84:53964) 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1352230973 learned_addr learned my addr 172.21.15.84:0/1352230973 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca37fe640 1 --2- 172.21.15.84:0/1352230973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca415b6d0 0x7f3ca40cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1352230973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca415b6d0 msgr2=0x7f3ca40cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 --2- 172.21.15.84:0/1352230973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca415b6d0 0x7f3ca40cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1352230973 >> v1:172.21.15.175:6789/0 conn(0x7f3ca40b3930 legacy=0x7f3ca415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.049+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1352230973 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca415ea90 con 0x7f3ca4155160 2024-04-14T10:57:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.050+0000 7f3ca2ffd640 1 --2- 172.21.15.84:0/1352230973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca4155160 0x7f3ca40cb3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009870 tx=0x7f3c9402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62759b94a4ca428 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.050+0000 7f3ca1ffb640 1 -- 172.21.15.84:0/1352230973 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9402f840 con 0x7f3ca4155160 2024-04-14T10:57:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.050+0000 7f3ca1ffb640 1 -- 172.21.15.84:0/1352230973 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9402f9e0 con 0x7f3ca4155160 2024-04-14T10:57:57.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.050+0000 7f3ca1ffb640 1 -- 172.21.15.84:0/1352230973 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9402fdb0 con 0x7f3ca4155160 2024-04-14T10:57:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1352230973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca4155160 msgr2=0x7f3ca40cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1352230973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca4155160 0x7f3ca40cb3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009870 tx=0x7f3c9402ba20 comp rx=0 tx=0).stop 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1352230973 shutdown_connections 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1352230973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca415b6d0 0x7f3ca40cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1352230973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca4155160 0x7f3ca40cb3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1352230973 >> 172.21.15.84:0/1352230973 conn(0x7f3ca406b900 msgr2=0x7f3ca406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1352230973 shutdown_connections 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.051+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1352230973 wait complete. 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.052+0000 7f3ca9a60640 1 Processor -- start 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.052+0000 7f3ca9a60640 1 -- start start 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 0x7f3ca40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ca415b6d0 0x7f3ca41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca41514b0 0x7f3ca4157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca4155540 con 0x7f3ca40b3930 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca415f050 con 0x7f3ca415b6d0 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca40cc150 con 0x7f3ca41514b0 2024-04-14T10:57:57.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 0x7f3ca40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 0x7f3ca40c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53970/0 (socket says 172.21.15.84:53970) 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1078329596 learned_addr learned my addr 172.21.15.84:0/1078329596 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca27fc640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ca415b6d0 0x7f3ca41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca37fe640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca41514b0 0x7f3ca4157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca41514b0 msgr2=0x7f3ca4157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca41514b0 0x7f3ca4157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ca415b6d0 msgr2=0x7f3ca41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ca415b6d0 0x7f3ca41575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 -- 172.21.15.84:0/1078329596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca40cf050 con 0x7f3ca40b3930 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca2ffd640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 0x7f3ca40c8e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c9402bfb0 tx=0x7f3c94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94037d40 con 0x7f3ca40b3930 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c94042430 con 0x7f3ca40b3930 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca40cf330 con 0x7f3ca40b3930 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94042820 con 0x7f3ca40b3930 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.053+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca40cf8f0 con 0x7f3ca40b3930 2024-04-14T10:57:57.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.054+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca4069c30 con 0x7f3ca40b3930 2024-04-14T10:57:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.055+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c94049060 con 0x7f3ca40b3930 2024-04-14T10:57:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.055+0000 7f3c8bfff640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3c9006c8f0 0x7f3c9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.055+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3c940ad770 con 0x7f3ca40b3930 2024-04-14T10:57:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.055+0000 7f3ca27fc640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3c9006c8f0 0x7f3c9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.056+0000 7f3ca27fc640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3c9006c8f0 0x7f3c9006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40cb3d0 tx=0x7f3c98009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.060+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f3c94033030 con 0x7f3ca40b3930 2024-04-14T10:57:57.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.238+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ca40cbf30 con 0x7f3ca40b3930 2024-04-14T10:57:57.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.238+0000 7f3c8bfff640 1 -- 172.21.15.84:0/1078329596 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7f3c9407b9f0 con 0x7f3ca40b3930 2024-04-14T10:57:57.238 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:57.238 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:57:53.552116+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:57:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3c9006c8f0 msgr2=0x7f3c9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3c9006c8f0 0x7f3c9006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40cb3d0 tx=0x7f3c98009040 comp rx=0 tx=0).stop 2024-04-14T10:57:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 msgr2=0x7f3ca40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 0x7f3ca40c8e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3c9402bfb0 tx=0x7f3c94004730 comp rx=0 tx=0).stop 2024-04-14T10:57:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 shutdown_connections 2024-04-14T10:57:57.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3c9006c8f0 0x7f3c9006edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ca41514b0 0x7f3ca4157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ca415b6d0 0x7f3ca41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 --2- 172.21.15.84:0/1078329596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3ca40b3930 0x7f3ca40c8e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 >> 172.21.15.84:0/1078329596 conn(0x7f3ca406b900 msgr2=0x7f3ca40caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:57.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 shutdown_connections 2024-04-14T10:57:57.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.241+0000 7f3ca9a60640 1 -- 172.21.15.84:0/1078329596 wait complete. 2024-04-14T10:57:57.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:57:57.251 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:57:57.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.354+0000 7f31e2f1e640 1 Processor -- start 2024-04-14T10:57:57.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.354+0000 7f31e2f1e640 1 -- start start 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e2f1e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 0x7f31dc0ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e2f1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc0ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e2f1e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31dc15c3f0 con 0x7f31dc06fb10 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e2f1e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f31dc0c4b30 con 0x7f31dc152f80 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e2f1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc15cf50 con 0x7f31dc0ca350 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e14bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc0ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.355+0000 7f31e0cba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 0x7f31dc0ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e0cba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 0x7f31dc0ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:39480/0 (socket says 172.21.15.84:39480) 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e0cba640 1 -- 172.21.15.84:0/2263976879 learned_addr learned my addr 172.21.15.84:0/2263976879 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31dbfff640 1 --1- 172.21.15.84:0/2263976879 >> v1:172.21.15.175:6789/0 conn(0x7f31dc06fb10 0x7f31dc0c9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:57270/0 (socket says 172.21.15.84:57270) 2024-04-14T10:57:57.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e14bb640 1 -- 172.21.15.84:0/2263976879 >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 msgr2=0x7f31dc0ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e14bb640 1 --2- 172.21.15.84:0/2263976879 >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 0x7f31dc0ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e14bb640 1 -- 172.21.15.84:0/2263976879 >> v1:172.21.15.175:6789/0 conn(0x7f31dc06fb10 legacy=0x7f31dc0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e14bb640 1 -- 172.21.15.84:0/2263976879 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc15c6b0 con 0x7f31dc0ca350 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.356+0000 7f31e0cba640 1 --2- 172.21.15.84:0/2263976879 >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 0x7f31dc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e14bb640 1 --2- 172.21.15.84:0/2263976879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc0ce8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009d90 tx=0x7f31d402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c5154232d93dee server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31db7fe640 1 -- 172.21.15.84:0/2263976879 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4039070 con 0x7f31dc0ca350 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31db7fe640 1 -- 172.21.15.84:0/2263976879 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d402cc50 con 0x7f31dc0ca350 2024-04-14T10:57:57.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31db7fe640 1 -- 172.21.15.84:0/2263976879 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4034440 con 0x7f31dc0ca350 2024-04-14T10:57:57.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 -- 172.21.15.84:0/2263976879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 msgr2=0x7f31dc0ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/2263976879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc0ce8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009d90 tx=0x7f31d402bea0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 -- 172.21.15.84:0/2263976879 shutdown_connections 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/2263976879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc0ce8d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/2263976879 >> v2:172.21.15.175:3300/0 conn(0x7f31dc152f80 0x7f31dc0ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 -- 172.21.15.84:0/2263976879 >> 172.21.15.84:0/2263976879 conn(0x7f31dc067db0 msgr2=0x7f31dc0716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 -- 172.21.15.84:0/2263976879 shutdown_connections 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.357+0000 7f31e2f1e640 1 -- 172.21.15.84:0/2263976879 wait complete. 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.358+0000 7f31e2f1e640 1 Processor -- start 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.358+0000 7f31e2f1e640 1 -- start start 2024-04-14T10:57:57.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e2f1e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc06fb10 0x7f31dc15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e2f1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e2f1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 0x7f31dc1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e2f1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc15cc70 con 0x7f31dc152f80 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e2f1e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31dc0c97b0 con 0x7f31dc06fb10 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e2f1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f31dc15c040 con 0x7f31dc0ca350 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e14bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 0x7f31dc1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e14bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 0x7f31dc1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53984/0 (socket says 172.21.15.84:53984) 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.359+0000 7f31e14bb640 1 -- 172.21.15.84:0/1262054908 learned_addr learned my addr 172.21.15.84:0/1262054908 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31dbfff640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e0cba640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc06fb10 0x7f31dc15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e14bb640 1 -- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 msgr2=0x7f31dc154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e14bb640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e14bb640 1 -- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc06fb10 msgr2=0x7f31dc15b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e14bb640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc06fb10 0x7f31dc15b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e14bb640 1 -- 172.21.15.84:0/1262054908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31dc155ca0 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e14bb640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 0x7f31dc1491c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009d90 tx=0x7f31d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4039050 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d4045070 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31dc1e3ed0 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4009450 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.360+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31dc1e4450 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.361+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31dc069b20 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.361+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31d403e610 con 0x7f31dc152f80 2024-04-14T10:57:57.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.362+0000 7f31d97fa640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f31c806c8f0 0x7f31c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.362+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f31d40ae2e0 con 0x7f31dc152f80 2024-04-14T10:57:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.362+0000 7f31e0cba640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f31c806c8f0 0x7f31c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.362+0000 7f31e0cba640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f31c806c8f0 0x7f31c806edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009b50 tx=0x7f31cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.366+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f31d407ca60 con 0x7f31dc152f80 2024-04-14T10:57:57.541 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.542+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f31dc0c4170 con 0x7f31dc152f80 2024-04-14T10:57:57.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.542+0000 7f31d97fa640 1 -- 172.21.15.84:0/1262054908 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f31d407c360 con 0x7f31dc152f80 2024-04-14T10:57:57.542 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f31c806c8f0 msgr2=0x7f31c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f31c806c8f0 0x7f31c806edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009b50 tx=0x7f31cc008040 comp rx=0 tx=0).stop 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 msgr2=0x7f31dc1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 0x7f31dc1491c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009d90 tx=0x7f31d4004a40 comp rx=0 tx=0).stop 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 shutdown_connections 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f31c806c8f0 0x7f31c806edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31dc152f80 0x7f31dc1491c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31dc0ca350 0x7f31dc154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 --2- 172.21.15.84:0/1262054908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31dc06fb10 0x7f31dc15b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 >> 172.21.15.84:0/1262054908 conn(0x7f31dc067db0 msgr2=0x7f31dc0c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 shutdown_connections 2024-04-14T10:57:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.544+0000 7f31e2f1e640 1 -- 172.21.15.84:0/1262054908 wait complete. 2024-04-14T10:57:57.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:57:57.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.654+0000 7f794f511640 1 Processor -- start 2024-04-14T10:57:57.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.654+0000 7f794f511640 1 -- start start 2024-04-14T10:57:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794f511640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f794815b6d0 0x7f79480cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794f511640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79480ccd90 con 0x7f79480b3930 2024-04-14T10:57:57.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794f511640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794815e4d0 con 0x7f7948155160 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794f511640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f794815e7b0 con 0x7f794815b6d0 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794caac640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f79480b3930 0x7f794815afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39244/0 (socket says 172.21.15.84:39244) 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794caac640 1 -- 172.21.15.84:0/384568315 learned_addr learned my addr 172.21.15.84:0/384568315 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794daae640 1 --2- 172.21.15.84:0/384568315 >> v2:172.21.15.84:3300/0 conn(0x7f794815b6d0 0x7f79480cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794daae640 1 -- 172.21.15.84:0/384568315 >> v1:172.21.15.175:6789/0 conn(0x7f7948155160 legacy=0x7f79480cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794daae640 1 -- 172.21.15.84:0/384568315 >> v1:172.21.15.84:6789/0 conn(0x7f79480b3930 legacy=0x7f794815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f794daae640 1 -- 172.21.15.84:0/384568315 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794815ea90 con 0x7f794815b6d0 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.655+0000 7f793ffff640 1 -- 172.21.15.84:0/384568315 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292451089 0 0) 0x7f79480ccd90 con 0x7f79480b3930 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.656+0000 7f794daae640 1 --2- 172.21.15.84:0/384568315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794815b6d0 0x7f79480cc150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7940009d90 tx=0x7f794002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1ae89790cf8e61 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.656+0000 7f793ffff640 1 -- 172.21.15.84:0/384568315 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940039070 con 0x7f794815b6d0 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.656+0000 7f793ffff640 1 -- 172.21.15.84:0/384568315 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f794002cd00 con 0x7f794815b6d0 2024-04-14T10:57:57.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.656+0000 7f793ffff640 1 -- 172.21.15.84:0/384568315 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940034660 con 0x7f794815b6d0 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 -- 172.21.15.84:0/384568315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794815b6d0 msgr2=0x7f79480cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 --2- 172.21.15.84:0/384568315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794815b6d0 0x7f79480cc150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7940009d90 tx=0x7f794002bf50 comp rx=0 tx=0).stop 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 -- 172.21.15.84:0/384568315 shutdown_connections 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 --2- 172.21.15.84:0/384568315 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f794815b6d0 0x7f79480cc150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 -- 172.21.15.84:0/384568315 >> 172.21.15.84:0/384568315 conn(0x7f794806b900 msgr2=0x7f794806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 -- 172.21.15.84:0/384568315 shutdown_connections 2024-04-14T10:57:57.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.657+0000 7f794f511640 1 -- 172.21.15.84:0/384568315 wait complete. 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.658+0000 7f794f511640 1 Processor -- start 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.658+0000 7f794f511640 1 -- start start 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 0x7f79480cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7948155160 0x7f7948159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f794815b6d0 0x7f7948159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7948155540 con 0x7f79480b3930 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f794815f050 con 0x7f794815b6d0 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f79480cbae0 con 0x7f7948155160 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 0x7f79480cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 0x7f79480cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54004/0 (socket says 172.21.15.84:54004) 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 -- 172.21.15.84:0/1488930687 learned_addr learned my addr 172.21.15.84:0/1488930687 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:57:57.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794caac640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7948155160 0x7f7948159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794daae640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f794815b6d0 0x7f7948159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 -- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7948155160 msgr2=0x7f7948159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7948155160 0x7f7948159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 -- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f794815b6d0 msgr2=0x7f7948159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f794815b6d0 0x7f7948159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 -- 172.21.15.84:0/1488930687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79480c9460 con 0x7f79480b3930 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794d2ad640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 0x7f79480cfc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f794400c460 tx=0x7f794400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944016020 con 0x7f79480b3930 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7944012870 con 0x7f79480b3930 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79480c9740 con 0x7f79480b3930 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.659+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944012c60 con 0x7f79480b3930 2024-04-14T10:57:57.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.660+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794815d780 con 0x7f79480b3930 2024-04-14T10:57:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.661+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7948069c30 con 0x7f79480b3930 2024-04-14T10:57:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.661+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7944019020 con 0x7f79480b3930 2024-04-14T10:57:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.661+0000 7f793dffb640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f792c06c8f0 0x7f792c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:57:57.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.661+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f794408b8d0 con 0x7f79480b3930 2024-04-14T10:57:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.661+0000 7f794caac640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f792c06c8f0 0x7f792c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:57:57.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.662+0000 7f794caac640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f792c06c8f0 0x7f792c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f79480b40c0 tx=0x7f7938007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:57:57.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.666+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f7944020020 con 0x7f79480b3930 2024-04-14T10:57:57.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.877+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79480cbf30 con 0x7f79480b3930 2024-04-14T10:57:57.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.877+0000 7f793dffb640 1 -- 172.21.15.84:0/1488930687 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f79440182c0 con 0x7f79480b3930 2024-04-14T10:57:57.877 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:57:57.877 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-14T10:57:57.877 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f792c06c8f0 msgr2=0x7f792c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f792c06c8f0 0x7f792c06edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f79480b40c0 tx=0x7f7938007b50 comp rx=0 tx=0).stop 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 msgr2=0x7f79480cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 0x7f79480cfc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f794400c460 tx=0x7f794400c920 comp rx=0 tx=0).stop 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 shutdown_connections 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f792c06c8f0 0x7f792c06edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f794815b6d0 0x7f7948159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7948155160 0x7f7948159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 --2- 172.21.15.84:0/1488930687 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79480b3930 0x7f79480cfc00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 >> 172.21.15.84:0/1488930687 conn(0x7f794806b900 msgr2=0x7f79480cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:57:57.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 shutdown_connections 2024-04-14T10:57:57.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:57:57.879+0000 7f794f511640 1 -- 172.21.15.84:0/1488930687 wait complete. 2024-04-14T10:57:59.889 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:00.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.002+0000 7f3a45b1e640 1 Processor -- start 2024-04-14T10:58:00.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.002+0000 7f3a45b1e640 1 -- start start 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a45b1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40155160 0x7f3a400cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a45b1e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a400b3930 0x7f3a400cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a45b1e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a4015afc0 0x7f3a4015b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a45b1e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3a4015b990 con 0x7f3a400b3930 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a45b1e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3a400ccd90 con 0x7f3a4015afc0 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a45b1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4015e4d0 con 0x7f3a40155160 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a400b3930 0x7f3a400cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f3a400b3930 0x7f3a400cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54016/0 (socket says 172.21.15.84:54016) 2024-04-14T10:58:00.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 -- 172.21.15.84:0/422628651 learned_addr learned my addr 172.21.15.84:0/422628651 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3f7fe640 1 --2- 172.21.15.84:0/422628651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40155160 0x7f3a400cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3ffff640 1 --2- 172.21.15.84:0/422628651 >> v2:172.21.15.175:3300/0 conn(0x7f3a4015afc0 0x7f3a4015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 -- 172.21.15.84:0/422628651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40155160 msgr2=0x7f3a400cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 --2- 172.21.15.84:0/422628651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40155160 0x7f3a400cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 -- 172.21.15.84:0/422628651 >> v2:172.21.15.175:3300/0 conn(0x7f3a4015afc0 msgr2=0x7f3a4015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 --2- 172.21.15.84:0/422628651 >> v2:172.21.15.175:3300/0 conn(0x7f3a4015afc0 0x7f3a4015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3effd640 1 -- 172.21.15.84:0/422628651 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4015e7b0 con 0x7f3a400b3930 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.003+0000 7f3a3ffff640 1 --2- 172.21.15.84:0/422628651 >> v2:172.21.15.175:3300/0 conn(0x7f3a4015afc0 0x7f3a4015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.004+0000 7f3a3effd640 1 --2- 172.21.15.84:0/422628651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400b3930 0x7f3a400cb910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a400b3850 tx=0x7f3a3402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51df11add08880e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.004+0000 7f3a3e7fc640 1 -- 172.21.15.84:0/422628651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34034070 con 0x7f3a400b3930 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.004+0000 7f3a3e7fc640 1 -- 172.21.15.84:0/422628651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a34030860 con 0x7f3a400b3930 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.004+0000 7f3a3e7fc640 1 -- 172.21.15.84:0/422628651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34030c30 con 0x7f3a400b3930 2024-04-14T10:58:00.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 -- 172.21.15.84:0/422628651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400b3930 msgr2=0x7f3a400cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/422628651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400b3930 0x7f3a400cb910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a400b3850 tx=0x7f3a3402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 -- 172.21.15.84:0/422628651 shutdown_connections 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/422628651 >> v2:172.21.15.175:3300/0 conn(0x7f3a4015afc0 0x7f3a4015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/422628651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a400b3930 0x7f3a400cb910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/422628651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a40155160 0x7f3a400cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 -- 172.21.15.84:0/422628651 >> 172.21.15.84:0/422628651 conn(0x7f3a4006b900 msgr2=0x7f3a4006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 -- 172.21.15.84:0/422628651 shutdown_connections 2024-04-14T10:58:00.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.005+0000 7f3a45b1e640 1 -- 172.21.15.84:0/422628651 wait complete. 2024-04-14T10:58:00.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.006+0000 7f3a45b1e640 1 Processor -- start 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.006+0000 7f3a45b1e640 1 -- start start 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a45b1e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a400b3930 0x7f3a400d0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a45b1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 0x7f3a400d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a45b1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a4015afc0 0x7f3a4014a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a45b1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4015f050 con 0x7f3a40155160 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a45b1e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4015ed70 con 0x7f3a400b3930 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a45b1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3a40155540 con 0x7f3a4015afc0 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 0x7f3a400d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 0x7f3a400d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54018/0 (socket says 172.21.15.84:54018) 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 -- 172.21.15.84:0/1109882765 learned_addr learned my addr 172.21.15.84:0/1109882765 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3ffff640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a4015afc0 0x7f3a4014a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3f7fe640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a400b3930 0x7f3a400d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 -- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a4015afc0 msgr2=0x7f3a4014a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a4015afc0 0x7f3a4014a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 -- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a400b3930 msgr2=0x7f3a400d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a400b3930 0x7f3a400d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.007+0000 7f3a3effd640 1 -- 172.21.15.84:0/1109882765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a400d12e0 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.008+0000 7f3a3effd640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 0x7f3a400d0a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a3402b9e0 tx=0x7f3a34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.008+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34048070 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.008+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a34030660 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.008+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34034040 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.008+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4015d280 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.008+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4015d800 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.009+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a40069c30 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.009+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a3404b070 con 0x7f3a40155160 2024-04-14T10:58:00.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.010+0000 7f3a27fff640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3a2c06c8f0 0x7f3a2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.010+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3a340ad940 con 0x7f3a40155160 2024-04-14T10:58:00.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.010+0000 7f3a3f7fe640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3a2c06c8f0 0x7f3a2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.010+0000 7f3a3f7fe640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3a2c06c8f0 0x7f3a2c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a30006fd0 tx=0x7f3a30008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.014+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f3a3407c1e0 con 0x7f3a40155160 2024-04-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.226+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a400cbf30 con 0x7f3a40155160 2024-04-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.227+0000 7f3a27fff640 1 -- 172.21.15.84:0/1109882765 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7f3a34030830 con 0x7f3a40155160 2024-04-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:00.226 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4308,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-14T10:58:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 3 2024-04-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3a2c06c8f0 msgr2=0x7f3a2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3a2c06c8f0 0x7f3a2c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3a30006fd0 tx=0x7f3a30008040 comp rx=0 tx=0).stop 2024-04-14T10:58:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 msgr2=0x7f3a400d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 0x7f3a400d0a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a3402b9e0 tx=0x7f3a34004730 comp rx=0 tx=0).stop 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 shutdown_connections 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f3a2c06c8f0 0x7f3a2c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a4015afc0 0x7f3a4014a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3a40155160 0x7f3a400d0a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 --2- 172.21.15.84:0/1109882765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a400b3930 0x7f3a400d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 >> 172.21.15.84:0/1109882765 conn(0x7f3a4006b900 msgr2=0x7f3a40159030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 shutdown_connections 2024-04-14T10:58:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.229+0000 7f3a45b1e640 1 -- 172.21.15.84:0/1109882765 wait complete. 2024-04-14T10:58:00.239 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:00.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.339+0000 7fe3358de640 1 Processor -- start 2024-04-14T10:58:00.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.339+0000 7fe3358de640 1 -- start start 2024-04-14T10:58:00.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe3358de640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe33006fb60 0x7fe330072b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe3358de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe3358de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe330158d10 con 0x7fe330062c90 2024-04-14T10:58:00.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe3358de640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe330158ff0 con 0x7fe33006fb60 2024-04-14T10:58:00.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe3358de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe3301592d0 con 0x7fe33006ff40 2024-04-14T10:58:00.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe32e7fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.340+0000 7fe32effd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe33006fb60 0x7fe330072b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32effd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe33006fb60 0x7fe330072b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:39538/0 (socket says 172.21.15.84:39538) 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32e7fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:55180/0 (socket says 172.21.15.84:55180) 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32effd640 1 -- 172.21.15.84:0/2058115884 learned_addr learned my addr 172.21.15.84:0/2058115884 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32f7fe640 1 --1- 172.21.15.84:0/2058115884 >> v1:172.21.15.175:6789/0 conn(0x7fe330062c90 0x7fe33006dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:57276/0 (socket says 172.21.15.84:57276) 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32effd640 1 -- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 msgr2=0x7fe3300c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32effd640 1 --2- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32effd640 1 -- 172.21.15.84:0/2058115884 >> v1:172.21.15.175:6789/0 conn(0x7fe330062c90 legacy=0x7fe33006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.341+0000 7fe32effd640 1 -- 172.21.15.84:0/2058115884 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3301595b0 con 0x7fe33006fb60 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe32effd640 1 --2- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe330072b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe320009e50 tx=0x7fe32002bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8673438bd93aec server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe32dffb640 1 -- 172.21.15.84:0/2058115884 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32002cb90 con 0x7fe33006fb60 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe32dffb640 1 -- 172.21.15.84:0/2058115884 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32002cd30 con 0x7fe33006fb60 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe32dffb640 1 -- 172.21.15.84:0/2058115884 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe320034610 con 0x7fe33006fb60 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 -- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 msgr2=0x7fe330072b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 --2- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe330072b10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe320009e50 tx=0x7fe32002bff0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 -- 172.21.15.84:0/2058115884 shutdown_connections 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 --2- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 --2- 172.21.15.84:0/2058115884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe330072b10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 -- 172.21.15.84:0/2058115884 >> 172.21.15.84:0/2058115884 conn(0x7fe3300c98f0 msgr2=0x7fe3300c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 -- 172.21.15.84:0/2058115884 shutdown_connections 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.342+0000 7fe3358de640 1 -- 172.21.15.84:0/2058115884 wait complete. 2024-04-14T10:58:00.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.343+0000 7fe3358de640 1 Processor -- start 2024-04-14T10:58:00.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 -- start start 2024-04-14T10:58:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 0x7fe3301412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe3300c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe33006e850 con 0x7fe330062c90 2024-04-14T10:58:00.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe33006e6d0 con 0x7fe33006fb60 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe3358de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe33015a150 con 0x7fe33006ff40 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe32effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 0x7fe3301412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe32effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 0x7fe3301412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54034/0 (socket says 172.21.15.84:54034) 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.344+0000 7fe32effd640 1 -- 172.21.15.84:0/2289348829 learned_addr learned my addr 172.21.15.84:0/2289348829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32e7fc640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe3300c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32f7fe640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32effd640 1 -- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 msgr2=0x7fe3300c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32effd640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32effd640 1 -- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 msgr2=0x7fe3300c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32effd640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe3300c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32effd640 1 -- 172.21.15.84:0/2289348829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33015a4e0 con 0x7fe330062c90 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe32effd640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 0x7fe3301412c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe320036040 tx=0x7fe320004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe320043020 con 0x7fe330062c90 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32003e450 con 0x7fe330062c90 2024-04-14T10:58:00.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe330157fb0 con 0x7fe330062c90 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe320009510 con 0x7fe330062c90 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.345+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3300c2440 con 0x7fe330062c90 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.346+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe330069c30 con 0x7fe330062c90 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.347+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe320046020 con 0x7fe330062c90 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.347+0000 7fe317fff640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe31c06c920 0x7fe31c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.347+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe3200add20 con 0x7fe330062c90 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.347+0000 7fe32e7fc640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe31c06c920 0x7fe31c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.347+0000 7fe32e7fc640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe31c06c920 0x7fe31c06ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe330070560 tx=0x7fe324009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.351+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fe32004d030 con 0x7fe330062c90 2024-04-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.526+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe330069660 con 0x7fe330062c90 2024-04-14T10:58:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.527+0000 7fe317fff640 1 -- 172.21.15.84:0/2289348829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12860 (secure 0 0 0) 0x7fe330157fb0 con 0x7fe330062c90 2024-04-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:00.527 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":16,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:57:53.552116+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe31c06c920 msgr2=0x7fe31c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe31c06c920 0x7fe31c06ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe330070560 tx=0x7fe324009190 comp rx=0 tx=0).stop 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 msgr2=0x7fe3301412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 0x7fe3301412c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe320036040 tx=0x7fe320004a40 comp rx=0 tx=0).stop 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 shutdown_connections 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe31c06c920 0x7fe31c06ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe33006ff40 0x7fe3300c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe33006fb60 0x7fe3300c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 --2- 172.21.15.84:0/2289348829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe330062c90 0x7fe3301412c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 >> 172.21.15.84:0/2289348829 conn(0x7fe3300c98f0 msgr2=0x7fe3300c5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 shutdown_connections 2024-04-14T10:58:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.529+0000 7fe3358de640 1 -- 172.21.15.84:0/2289348829 wait complete. 2024-04-14T10:58:00.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:58:00.540 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:58:00.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.643+0000 7f82ca860640 1 Processor -- start 2024-04-14T10:58:00.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.643+0000 7f82ca860640 1 -- start start 2024-04-14T10:58:00.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82ca860640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82c40ccbf0 0x7f82c40c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82ca860640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c40c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82ca860640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c415e910 con 0x7f82c415e3b0 2024-04-14T10:58:00.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82ca860640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f82c40c45f0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82ca860640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82c415ebf0 con 0x7f82c40ccfd0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c3fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82c40ccbf0 0x7f82c40c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c8dfd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f82c415e3b0 0x7f82c4154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:57288/0 (socket says 172.21.15.84:57288) 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c8dfd640 1 -- 172.21.15.84:0/1065877371 learned_addr learned my addr 172.21.15.84:0/1065877371 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c37fe640 1 --2- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c40c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c3fff640 1 -- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 msgr2=0x7f82c40c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c3fff640 1 --2- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c40c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c3fff640 1 -- 172.21.15.84:0/1065877371 >> v1:172.21.15.175:6789/0 conn(0x7f82c415e3b0 legacy=0x7f82c4154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.644+0000 7f82c3fff640 1 -- 172.21.15.84:0/1065877371 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c415eed0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.645+0000 7f82c3fff640 1 --2- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c40ccbf0 0x7f82c40c4a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82b40097a0 tx=0x7f82b402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c746c169cf7041e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.645+0000 7f82c2ffd640 1 -- 172.21.15.84:0/1065877371 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4034070 con 0x7f82c40ccbf0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.645+0000 7f82c2ffd640 1 -- 172.21.15.84:0/1065877371 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b4030610 con 0x7f82c40ccbf0 2024-04-14T10:58:00.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.645+0000 7f82c2ffd640 1 -- 172.21.15.84:0/1065877371 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b40309e0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 -- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c40ccbf0 msgr2=0x7f82c40c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 --2- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c40ccbf0 0x7f82c40c4a80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82b40097a0 tx=0x7f82b402b960 comp rx=0 tx=0).stop 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 -- 172.21.15.84:0/1065877371 shutdown_connections 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 --2- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c40c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 --2- 172.21.15.84:0/1065877371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c40ccbf0 0x7f82c40c4a80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 -- 172.21.15.84:0/1065877371 >> 172.21.15.84:0/1065877371 conn(0x7f82c4067900 msgr2=0x7f82c406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 -- 172.21.15.84:0/1065877371 shutdown_connections 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.646+0000 7f82ca860640 1 -- 172.21.15.84:0/1065877371 wait complete. 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.647+0000 7f82ca860640 1 Processor -- start 2024-04-14T10:58:00.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.647+0000 7f82ca860640 1 -- start start 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 0x7f82c41500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c41f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c415e3b0 0x7f82c4146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4155390 con 0x7f82c40ccbf0 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82c415f1b0 con 0x7f82c415e3b0 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82c4155510 con 0x7f82c40ccfd0 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 0x7f82c41500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 0x7f82c41500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54042/0 (socket says 172.21.15.84:54042) 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 -- 172.21.15.84:0/1230316226 learned_addr learned my addr 172.21.15.84:0/1230316226 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c37fe640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c41f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c8dfd640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c415e3b0 0x7f82c4146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 -- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 msgr2=0x7f82c41f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c41f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 -- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c415e3b0 msgr2=0x7f82c4146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c415e3b0 0x7f82c4146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 -- 172.21.15.84:0/1230316226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c415bc70 con 0x7f82c40ccbf0 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c3fff640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 0x7f82c41500f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82b40098c0 tx=0x7f82b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4034040 con 0x7f82c40ccbf0 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c415c120 con 0x7f82c40ccbf0 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b4030410 con 0x7f82c40ccbf0 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.648+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4039c70 con 0x7f82c40ccbf0 2024-04-14T10:58:00.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.649+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c40ce130 con 0x7f82c40ccbf0 2024-04-14T10:58:00.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.649+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c4069b20 con 0x7f82c40ccbf0 2024-04-14T10:58:00.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.650+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82b4037070 con 0x7f82c40ccbf0 2024-04-14T10:58:00.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.650+0000 7f82c0ff9640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f82b006c8f0 0x7f82b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.650+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f82b40ad6f0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.650+0000 7f82c37fe640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f82b006c8f0 0x7f82b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.651+0000 7f82c37fe640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f82b006c8f0 0x7f82b006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82c40cf140 tx=0x7f82b8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.655+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f82b407b7a0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.828+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82c40c9fa0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.829+0000 7f82c0ff9640 1 -- 172.21.15.84:0/1230316226 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f82b407faa0 con 0x7f82c40ccbf0 2024-04-14T10:58:00.828 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f82b006c8f0 msgr2=0x7f82b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f82b006c8f0 0x7f82b006edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82c40cf140 tx=0x7f82b8009190 comp rx=0 tx=0).stop 2024-04-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 msgr2=0x7f82c41500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 0x7f82c41500f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82b40098c0 tx=0x7f82b40046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 shutdown_connections 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f82b006c8f0 0x7f82b006edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82c415e3b0 0x7f82c4146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82c40ccfd0 0x7f82c41f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 --2- 172.21.15.84:0/1230316226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82c40ccbf0 0x7f82c41500f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 >> 172.21.15.84:0/1230316226 conn(0x7f82c4067900 msgr2=0x7f82c40ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 shutdown_connections 2024-04-14T10:58:00.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.831+0000 7f82ca860640 1 -- 172.21.15.84:0/1230316226 wait complete. 2024-04-14T10:58:00.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T10:58:00.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.941+0000 7f2d3b098640 1 Processor -- start 2024-04-14T10:58:00.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.941+0000 7f2d3b098640 1 -- start start 2024-04-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d3b098640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d340ce320 0x7f2d340ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d3b098640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d3415c6e0 0x7f2d3415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d3b098640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d34070200 con 0x7f2d341551d0 2024-04-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d3b098640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2d3415acd0 con 0x7f2d3415c6e0 2024-04-14T10:58:00.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d3b098640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3415af70 con 0x7f2d340ce320 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d38e34640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2d341551d0 0x7f2d3406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39258/0 (socket says 172.21.15.84:39258) 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d38e34640 1 -- 172.21.15.84:0/3165892634 learned_addr learned my addr 172.21.15.84:0/3165892634 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d33fff640 1 --2- 172.21.15.84:0/3165892634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d340ce320 0x7f2d340ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d39635640 1 --2- 172.21.15.84:0/3165892634 >> v2:172.21.15.175:3300/0 conn(0x7f2d3415c6e0 0x7f2d3415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d337fe640 1 -- 172.21.15.84:0/3165892634 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363274859 0 0) 0x7f2d34070200 con 0x7f2d341551d0 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d337fe640 1 -- 172.21.15.84:0/3165892634 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d1c003520 con 0x7f2d341551d0 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d33fff640 1 -- 172.21.15.84:0/3165892634 >> v2:172.21.15.175:3300/0 conn(0x7f2d3415c6e0 msgr2=0x7f2d3415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d33fff640 1 --2- 172.21.15.84:0/3165892634 >> v2:172.21.15.175:3300/0 conn(0x7f2d3415c6e0 0x7f2d3415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d337fe640 1 -- 172.21.15.84:0/3165892634 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4182737786 0 0) 0x7f2d1c003520 con 0x7f2d341551d0 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d33fff640 1 -- 172.21.15.84:0/3165892634 >> v1:172.21.15.84:6789/0 conn(0x7f2d341551d0 legacy=0x7f2d3406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d33fff640 1 -- 172.21.15.84:0/3165892634 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3415d0b0 con 0x7f2d340ce320 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.942+0000 7f2d39635640 1 --2- 172.21.15.84:0/3165892634 >> v2:172.21.15.175:3300/0 conn(0x7f2d3415c6e0 0x7f2d3415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.943+0000 7f2d33fff640 1 --2- 172.21.15.84:0/3165892634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d340ce320 0x7f2d340ce720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097a0 tx=0x7f2d2802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea77f98bab644777 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.943+0000 7f2d337fe640 1 -- 172.21.15.84:0/3165892634 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28038070 con 0x7f2d340ce320 2024-04-14T10:58:00.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.943+0000 7f2d337fe640 1 -- 172.21.15.84:0/3165892634 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d28031500 con 0x7f2d340ce320 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.943+0000 7f2d337fe640 1 -- 172.21.15.84:0/3165892634 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24001670 con 0x7f2d340ce320 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 -- 172.21.15.84:0/3165892634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d340ce320 msgr2=0x7f2d340ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 --2- 172.21.15.84:0/3165892634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d340ce320 0x7f2d340ce720 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d280097a0 tx=0x7f2d2802b820 comp rx=0 tx=0).stop 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 -- 172.21.15.84:0/3165892634 shutdown_connections 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 --2- 172.21.15.84:0/3165892634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d340ce320 0x7f2d340ce720 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 --2- 172.21.15.84:0/3165892634 >> v2:172.21.15.175:3300/0 conn(0x7f2d3415c6e0 0x7f2d3415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 -- 172.21.15.84:0/3165892634 >> 172.21.15.84:0/3165892634 conn(0x7f2d3406db10 msgr2=0x7f2d3406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 -- 172.21.15.84:0/3165892634 shutdown_connections 2024-04-14T10:58:00.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.944+0000 7f2d3b098640 1 -- 172.21.15.84:0/3165892634 wait complete. 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.945+0000 7f2d3b098640 1 Processor -- start 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.945+0000 7f2d3b098640 1 -- start start 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d3b098640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d340ce320 0x7f2d340717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d3b098640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d341551d0 0x7f2d341f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d3b098640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 0x7f2d341f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d3b098640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3415b7d0 con 0x7f2d3415c6e0 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d3b098640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3415b4f0 con 0x7f2d340ce320 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d3b098640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2d3415bab0 con 0x7f2d341551d0 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 0x7f2d341f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 0x7f2d341f23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54046/0 (socket says 172.21.15.84:54046) 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 -- 172.21.15.84:0/413174101 learned_addr learned my addr 172.21.15.84:0/413174101 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d33fff640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d341551d0 0x7f2d341f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d38e34640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d340ce320 0x7f2d340717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 -- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d341551d0 msgr2=0x7f2d341f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d341551d0 0x7f2d341f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 -- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d340ce320 msgr2=0x7f2d340717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d340ce320 0x7f2d340717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 -- 172.21.15.84:0/413174101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d340c66b0 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d39635640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 0x7f2d341f23d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009f00 tx=0x7f2d2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.946+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c018030 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.947+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00ce50 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.947+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d340c6970 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.947+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003bb0 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.947+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d340c7970 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.948+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d34069c30 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.948+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d2c01b070 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.948+0000 7f2d317fa640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2d2006c8f0 0x7f2d2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.948+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2d2c08c300 con 0x7f2d3415c6e0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.948+0000 7f2d38e34640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2d2006c8f0 0x7f2d2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:00.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.949+0000 7f2d38e34640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2d2006c8f0 0x7f2d2006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d24007a00 tx=0x7f2d24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:00.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:00.953+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f2d2c010040 con 0x7f2d3415c6e0 2024-04-14T10:58:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.132+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2d340c5480 con 0x7f2d3415c6e0 2024-04-14T10:58:01.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.132+0000 7f2d317fa640 1 -- 172.21.15.84:0/413174101 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f2d2c012340 con 0x7f2d3415c6e0 2024-04-14T10:58:01.131 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:01.131 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-04-14T10:58:01.131 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-04-14T10:58:01.132 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-04-14T10:58:01.132 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-04-14T10:58:01.132 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T10:58:01.132 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-04-14T10:58:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2d2006c8f0 msgr2=0x7f2d2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2d2006c8f0 0x7f2d2006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d24007a00 tx=0x7f2d24009040 comp rx=0 tx=0).stop 2024-04-14T10:58:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 msgr2=0x7f2d341f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 0x7f2d341f23d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009f00 tx=0x7f2d2c00c490 comp rx=0 tx=0).stop 2024-04-14T10:58:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 shutdown_connections 2024-04-14T10:58:01.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2d2006c8f0 0x7f2d2006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d3415c6e0 0x7f2d341f23d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d341551d0 0x7f2d341f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 --2- 172.21.15.84:0/413174101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d340ce320 0x7f2d340717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 >> 172.21.15.84:0/413174101 conn(0x7f2d3406db10 msgr2=0x7f2d341536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:01.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 shutdown_connections 2024-04-14T10:58:01.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.134+0000 7f2d3b098640 1 -- 172.21.15.84:0/413174101 wait complete. 2024-04-14T10:58:01.144 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T10:58:01.144 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T10:58:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.249+0000 7fb192d15640 1 Processor -- start 2024-04-14T10:58:01.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.249+0000 7fb192d15640 1 -- start start 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb192d15640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb18c0c9080 0x7fb18c0c36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb192d15640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb18c159910 con 0x7fb18c0ca0f0 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb192d15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb18c15c0e0 con 0x7fb18c152f50 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb192d15640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb18c0cba50 con 0x7fb18c0c9080 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb18c0c9080 0x7fb18c0c36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18bfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb18c0c9080 0x7fb18c0c36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54058/0 (socket says 172.21.15.84:54058) 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb1912b2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb18c0ca0f0 0x7fb18c0ca560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39272/0 (socket says 172.21.15.84:39272) 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18bfff640 1 -- 172.21.15.84:0/1875656196 learned_addr learned my addr 172.21.15.84:0/1875656196 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18bfff640 1 -- 172.21.15.84:0/1875656196 >> v1:172.21.15.175:6789/0 conn(0x7fb18c152f50 legacy=0x7fb18c0c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18bfff640 1 -- 172.21.15.84:0/1875656196 >> v1:172.21.15.84:6789/0 conn(0x7fb18c0ca0f0 legacy=0x7fb18c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18bfff640 1 -- 172.21.15.84:0/1875656196 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c15c3c0 con 0x7fb18c0c9080 2024-04-14T10:58:01.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.250+0000 7fb18b7fe640 1 -- 172.21.15.84:0/1875656196 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512204029 0 0) 0x7fb18c159910 con 0x7fb18c0ca0f0 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.251+0000 7fb18bfff640 1 --2- 172.21.15.84:0/1875656196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c0c9080 0x7fb18c0c36a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb180009870 tx=0x7fb18002bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbb2a7a0ad775d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.251+0000 7fb18b7fe640 1 -- 172.21.15.84:0/1875656196 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18002d870 con 0x7fb18c0c9080 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.251+0000 7fb18b7fe640 1 -- 172.21.15.84:0/1875656196 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18002da10 con 0x7fb18c0c9080 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.251+0000 7fb18b7fe640 1 -- 172.21.15.84:0/1875656196 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18002dde0 con 0x7fb18c0c9080 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 -- 172.21.15.84:0/1875656196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c0c9080 msgr2=0x7fb18c0c36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 --2- 172.21.15.84:0/1875656196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c0c9080 0x7fb18c0c36a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb180009870 tx=0x7fb18002bab0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 -- 172.21.15.84:0/1875656196 shutdown_connections 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 --2- 172.21.15.84:0/1875656196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c0c9080 0x7fb18c0c36a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 -- 172.21.15.84:0/1875656196 >> 172.21.15.84:0/1875656196 conn(0x7fb18c071800 msgr2=0x7fb18c071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 -- 172.21.15.84:0/1875656196 shutdown_connections 2024-04-14T10:58:01.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.252+0000 7fb192d15640 1 -- 172.21.15.84:0/1875656196 wait complete. 2024-04-14T10:58:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.253+0000 7fb192d15640 1 Processor -- start 2024-04-14T10:58:01.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.253+0000 7fb192d15640 1 -- start start 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb18c0c9080 0x7fb18c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb18c0ca0f0 0x7fb18c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 0x7fb18c1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c0c95e0 con 0x7fb18c152f50 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c15c980 con 0x7fb18c0c9080 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c15a7a0 con 0x7fb18c0ca0f0 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 0x7fb18c1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 0x7fb18c1f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54070/0 (socket says 172.21.15.84:54070) 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 -- 172.21.15.84:0/3232483649 learned_addr learned my addr 172.21.15.84:0/3232483649 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb18bfff640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb18c0ca0f0 0x7fb18c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:01.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb190ab1640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb18c0c9080 0x7fb18c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 -- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb18c0ca0f0 msgr2=0x7fb18c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb18c0ca0f0 0x7fb18c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 -- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb18c0c9080 msgr2=0x7fb18c15af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb18c0c9080 0x7fb18c15af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 -- 172.21.15.84:0/3232483649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c1e1e60 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb190ab1640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb18c0c9080 0x7fb18c15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1912b2640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 0x7fb18c1f2530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c760 tx=0x7fb18400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18400ce10 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18400a5e0 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18c159c10 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18400a9d0 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.254+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18c15a9f0 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.255+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18c15ac30 con 0x7fb18c152f50 2024-04-14T10:58:01.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.256+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb18400ab70 con 0x7fb18c152f50 2024-04-14T10:58:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.256+0000 7fb1897fa640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb17806c8f0 0x7fb17806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.256+0000 7fb190ab1640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb17806c8f0 0x7fb17806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.256+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb18408b5f0 con 0x7fb18c152f50 2024-04-14T10:58:01.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.257+0000 7fb190ab1640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb17806c8f0 0x7fb17806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007fd0 tx=0x7fb17c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:01.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.261+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fb18c15ac30 con 0x7fb18c152f50 2024-04-14T10:58:01.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:01.436+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb18c06c390 con 0x7fb18c152f50 2024-04-14T10:58:02.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.171+0000 7fb1897fa640 1 -- 172.21.15.84:0/3232483649 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fb18c06c390 con 0x7fb18c152f50 2024-04-14T10:58:02.170 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-04-14T10:58:02.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb17806c8f0 msgr2=0x7fb17806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb17806c8f0 0x7fb17806edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007fd0 tx=0x7fb17c009040 comp rx=0 tx=0).stop 2024-04-14T10:58:02.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 msgr2=0x7fb18c1f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 0x7fb18c1f2530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb18400c760 tx=0x7fb18400cc20 comp rx=0 tx=0).stop 2024-04-14T10:58:02.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 shutdown_connections 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb17806c8f0 0x7fb17806edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb18c152f50 0x7fb18c1f2530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb18c0ca0f0 0x7fb18c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 --2- 172.21.15.84:0/3232483649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb18c0c9080 0x7fb18c15af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 >> 172.21.15.84:0/3232483649 conn(0x7fb18c071800 msgr2=0x7fb18c0c4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 shutdown_connections 2024-04-14T10:58:02.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.173+0000 7fb192d15640 1 -- 172.21.15.84:0/3232483649 wait complete. 2024-04-14T10:58:02.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T10:58:02.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.297+0000 7fcf2cdfe640 1 Processor -- start 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.297+0000 7fcf2cdfe640 1 -- start start 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2cdfe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf28154f80 0x7fcf2815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2cdfe640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf2815b460 con 0x7fcf280701d0 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2cdfe640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf2815b740 con 0x7fcf280ce390 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2cdfe640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fcf28155360 con 0x7fcf28154f80 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf28154f80 0x7fcf2815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf25d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fcf280701d0 0x7fcf2815ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:39280/0 (socket says 172.21.15.84:39280) 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fcf28154f80 0x7fcf2815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54074/0 (socket says 172.21.15.84:54074) 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf25d9b640 1 -- 172.21.15.84:0/3259516691 learned_addr learned my addr 172.21.15.84:0/3259516691 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2659c640 1 -- 172.21.15.84:0/3259516691 >> v1:172.21.15.175:6789/0 conn(0x7fcf280ce390 legacy=0x7fcf281657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.298+0000 7fcf2659c640 1 -- 172.21.15.84:0/3259516691 >> v1:172.21.15.84:6789/0 conn(0x7fcf280701d0 legacy=0x7fcf2815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.299+0000 7fcf2659c640 1 -- 172.21.15.84:0/3259516691 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2815ba20 con 0x7fcf28154f80 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.299+0000 7fcf2659c640 1 --2- 172.21.15.84:0/3259516691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf28154f80 0x7fcf2815ae20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009dc0 tx=0x7fcf1802bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba74ef73bc7f5a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.299+0000 7fcf2559a640 1 -- 172.21.15.84:0/3259516691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18039070 con 0x7fcf28154f80 2024-04-14T10:58:02.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.299+0000 7fcf2559a640 1 -- 172.21.15.84:0/3259516691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1802ca10 con 0x7fcf28154f80 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.299+0000 7fcf2559a640 1 -- 172.21.15.84:0/3259516691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1802cde0 con 0x7fcf28154f80 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/3259516691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf28154f80 msgr2=0x7fcf2815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/3259516691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf28154f80 0x7fcf2815ae20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009dc0 tx=0x7fcf1802bce0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/3259516691 shutdown_connections 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/3259516691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf28154f80 0x7fcf2815ae20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/3259516691 >> 172.21.15.84:0/3259516691 conn(0x7fcf28071640 msgr2=0x7fcf28071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/3259516691 shutdown_connections 2024-04-14T10:58:02.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.300+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/3259516691 wait complete. 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.301+0000 7fcf2cdfe640 1 Processor -- start 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.301+0000 7fcf2cdfe640 1 -- start start 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2cdfe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280701d0 0x7fcf281f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2cdfe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 0x7fcf28143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2cdfe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf28154f80 0x7fcf281f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2cdfe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2815e820 con 0x7fcf280ce390 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2cdfe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2815f3c0 con 0x7fcf280701d0 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2cdfe640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcf280c9890 con 0x7fcf28154f80 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 0x7fcf28143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 0x7fcf28143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54084/0 (socket says 172.21.15.84:54084) 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 -- 172.21.15.84:0/1356901012 learned_addr learned my addr 172.21.15.84:0/1356901012 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:02.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2659c640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280701d0 0x7fcf281f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf26d9d640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf28154f80 0x7fcf281f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 -- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf28154f80 msgr2=0x7fcf281f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf28154f80 0x7fcf281f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 -- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280701d0 msgr2=0x7fcf281f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280701d0 0x7fcf281f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 -- 172.21.15.84:0/1356901012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf281f26b0 con 0x7fcf280ce390 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf2659c640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280701d0 0x7fcf281f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf26d9d640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf28154f80 0x7fcf281f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.302+0000 7fcf25d9b640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 0x7fcf28143fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c5f0 tx=0x7fcf1c00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.303+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c018070 con 0x7fcf280ce390 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.303+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1c0074e0 con 0x7fcf280ce390 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.303+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf280c39c0 con 0x7fcf280ce390 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.303+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c007690 con 0x7fcf280ce390 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.303+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf280c3f70 con 0x7fcf280ce390 2024-04-14T10:58:02.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.304+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf28069b50 con 0x7fcf280ce390 2024-04-14T10:58:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.304+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf1c01b070 con 0x7fcf280ce390 2024-04-14T10:58:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.304+0000 7fcf16ffd640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fcf0806c8f0 0x7fcf0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.304+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fcf1c08ae70 con 0x7fcf280ce390 2024-04-14T10:58:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.304+0000 7fcf2659c640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fcf0806c8f0 0x7fcf0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:02.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.305+0000 7fcf2659c640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fcf0806c8f0 0x7fcf0806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf18030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:02.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.309+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fcf1c059480 con 0x7fcf280ce390 2024-04-14T10:58:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:02.483+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcf28070d80 con 0x7fcf280ce390 2024-04-14T10:58:03.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.173+0000 7fcf16ffd640 1 -- 172.21.15.84:0/1356901012 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fcf1c058d80 con 0x7fcf280ce390 2024-04-14T10:58:03.172 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-04-14T10:58:03.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fcf0806c8f0 msgr2=0x7fcf0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:03.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fcf0806c8f0 0x7fcf0806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf18030000 comp rx=0 tx=0).stop 2024-04-14T10:58:03.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 msgr2=0x7fcf28143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:03.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 0x7fcf28143fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c5f0 tx=0x7fcf1c00cab0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 shutdown_connections 2024-04-14T10:58:03.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fcf0806c8f0 0x7fcf0806edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcf28154f80 0x7fcf281f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf280ce390 0x7fcf28143fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 --2- 172.21.15.84:0/1356901012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf280701d0 0x7fcf281f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 >> 172.21.15.84:0/1356901012 conn(0x7fcf28071640 msgr2=0x7fcf280ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:03.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 shutdown_connections 2024-04-14T10:58:03.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.176+0000 7fcf2cdfe640 1 -- 172.21.15.84:0/1356901012 wait complete. 2024-04-14T10:58:03.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T10:58:03.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:58:03.284 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:58:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.307+0000 7f4d1fcc0640 1 Processor -- start 2024-04-14T10:58:03.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1fcc0640 1 -- start start 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1fcc0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d18155340 0x7f4d1806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1fcc0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d180700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1fcc0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d1806dfd0 con 0x7f4d18154f60 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1fcc0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4d1806e2b0 con 0x7f4d18155340 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1fcc0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1806e590 con 0x7f4d1815ba00 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1d25b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d18155340 0x7f4d1806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:03.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1d25b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4d18155340 0x7f4d1806fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34390/0 (socket says 172.21.15.84:34390) 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1d25b640 1 -- 172.21.15.84:0/109530833 learned_addr learned my addr 172.21.15.84:0/109530833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.308+0000 7f4d1da5c640 1 --1- 172.21.15.84:0/109530833 >> v1:172.21.15.84:6789/0 conn(0x7f4d18154f60 0x7f4d180b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34196/0 (socket says 172.21.15.84:34196) 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1e25d640 1 --2- 172.21.15.84:0/109530833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d180700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1d25b640 1 -- 172.21.15.84:0/109530833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 msgr2=0x7f4d180700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1d25b640 1 --2- 172.21.15.84:0/109530833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d180700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1d25b640 1 -- 172.21.15.84:0/109530833 >> v1:172.21.15.84:6789/0 conn(0x7f4d18154f60 legacy=0x7f4d180b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1d25b640 1 -- 172.21.15.84:0/109530833 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1806e870 con 0x7f4d18155340 2024-04-14T10:58:03.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1ca5a640 1 -- 172.21.15.84:0/109530833 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866378753 0 0) 0x7f4d1806dfd0 con 0x7f4d18154f60 2024-04-14T10:58:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.309+0000 7f4d1d25b640 1 --2- 172.21.15.84:0/109530833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18155340 0x7f4d1806fb70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009870 tx=0x7f4d0802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f94534fe7b7adb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:03.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1ca5a640 1 -- 172.21.15.84:0/109530833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08035020 con 0x7f4d18155340 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1ca5a640 1 -- 172.21.15.84:0/109530833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d08031640 con 0x7f4d18155340 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1ca5a640 1 -- 172.21.15.84:0/109530833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0802d040 con 0x7f4d18155340 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/109530833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18155340 msgr2=0x7f4d1806fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/109530833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18155340 0x7f4d1806fb70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009870 tx=0x7f4d0802b8f0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/109530833 shutdown_connections 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/109530833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d180700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/109530833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18155340 0x7f4d1806fb70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/109530833 >> 172.21.15.84:0/109530833 conn(0x7f4d180c98f0 msgr2=0x7f4d180c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/109530833 shutdown_connections 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.310+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/109530833 wait complete. 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.311+0000 7f4d1fcc0640 1 Processor -- start 2024-04-14T10:58:03.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.311+0000 7f4d1fcc0640 1 -- start start 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1fcc0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 0x7f4d181f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1fcc0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d18159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1fcc0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18155fb0 0x7f4d1814a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1fcc0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180b2400 con 0x7f4d18154f60 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1fcc0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180b2280 con 0x7f4d18155fb0 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1fcc0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180c77f0 con 0x7f4d1815ba00 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1da5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 0x7f4d181f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1da5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 0x7f4d181f0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34406/0 (socket says 172.21.15.84:34406) 2024-04-14T10:58:03.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1da5c640 1 -- 172.21.15.84:0/3920496495 learned_addr learned my addr 172.21.15.84:0/3920496495 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1d25b640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d18159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1e25d640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18155fb0 0x7f4d1814a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.312+0000 7f4d1da5c640 1 -- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 msgr2=0x7f4d18159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1da5c640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d18159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1da5c640 1 -- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18155fb0 msgr2=0x7f4d1814a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1da5c640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18155fb0 0x7f4d1814a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1da5c640 1 -- 172.21.15.84:0/3920496495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d18158380 con 0x7f4d18154f60 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1da5c640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 0x7f4d181f0ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c500 tx=0x7f4d1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14018070 con 0x7f4d18154f60 2024-04-14T10:58:03.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d14007580 con 0x7f4d18154f60 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14004a20 con 0x7f4d18154f60 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d181f13e0 con 0x7f4d18154f60 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.313+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181544b0 con 0x7f4d18154f60 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.314+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d18154aa0 con 0x7f4d18154f60 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.314+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d1401b070 con 0x7f4d18154f60 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.315+0000 7f4d0e7fc640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:03.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.315+0000 7f4d1d25b640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:03.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.315+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f4d1408ad10 con 0x7f4d18154f60 2024-04-14T10:58:03.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.315+0000 7f4d1d25b640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4d08036000 tx=0x7f4d08008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:03.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.319+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f4d18158380 con 0x7f4d18154f60 2024-04-14T10:58:03.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:03.534+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4d18069b20 con 0x7f4d18154f60 2024-04-14T10:58:04.195 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-04-14T10:58:04.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.196+0000 7f4d0e7fc640 1 -- 172.21.15.84:0/3920496495 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f4d14058be0 con 0x7f4d18154f60 2024-04-14T10:58:04.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cfc06c8f0 msgr2=0x7f4cfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4d08036000 tx=0x7f4d08008030 comp rx=0 tx=0).stop 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 msgr2=0x7f4d181f0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 0x7f4d181f0ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c500 tx=0x7f4d1400c9c0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 shutdown_connections 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cfc06c8f0 0x7f4cfc06edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d18155fb0 0x7f4d1814a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d1815ba00 0x7f4d18159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 --2- 172.21.15.84:0/3920496495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d18154f60 0x7f4d181f0ea0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.206+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 >> 172.21.15.84:0/3920496495 conn(0x7f4d180c98f0 msgr2=0x7f4d18073690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.207+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 shutdown_connections 2024-04-14T10:58:04.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.207+0000 7f4d1fcc0640 1 -- 172.21.15.84:0/3920496495 wait complete. 2024-04-14T10:58:04.220 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:04.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.324+0000 7f91cd405640 1 Processor -- start 2024-04-14T10:58:04.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.324+0000 7f91cd405640 1 -- start start 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91cd405640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91c8152ba0 0x7f91c80738e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91cd405640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c806b900 0x7f91c80c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91cd405640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c8152f80 con 0x7f91c80c70c0 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91cd405640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f91c806ca40 con 0x7f91c8152ba0 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91cd405640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91c8073ed0 con 0x7f91c806b900 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91c6ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91c8152ba0 0x7f91c80738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91c77fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f91c80c70c0 0x7f91c8158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34198/0 (socket says 172.21.15.84:34198) 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91c6ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91c8152ba0 0x7f91c80738e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34420/0 (socket says 172.21.15.84:34420) 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.325+0000 7f91c77fe640 1 -- 172.21.15.84:0/2602712617 learned_addr learned my addr 172.21.15.84:0/2602712617 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:04.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c67fc640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c806b900 0x7f91c80c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c6ffd640 1 -- 172.21.15.84:0/2602712617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c806b900 msgr2=0x7f91c80c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c6ffd640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c806b900 0x7f91c80c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c6ffd640 1 -- 172.21.15.84:0/2602712617 >> v1:172.21.15.84:6789/0 conn(0x7f91c80c70c0 legacy=0x7f91c8158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c6ffd640 1 -- 172.21.15.84:0/2602712617 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c80c7f10 con 0x7f91c8152ba0 2024-04-14T10:58:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c5ffb640 1 -- 172.21.15.84:0/2602712617 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678126466 0 0) 0x7f91c8152f80 con 0x7f91c80c70c0 2024-04-14T10:58:04.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c67fc640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c806b900 0x7f91c80c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c6ffd640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c80738e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009d90 tx=0x7f91b802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d625c2533c865e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c5ffb640 1 -- 172.21.15.84:0/2602712617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8039070 con 0x7f91c8152ba0 2024-04-14T10:58:04.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c5ffb640 1 -- 172.21.15.84:0/2602712617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b802cce0 con 0x7f91c8152ba0 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.326+0000 7f91c5ffb640 1 -- 172.21.15.84:0/2602712617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8034660 con 0x7f91c8152ba0 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 -- 172.21.15.84:0/2602712617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 msgr2=0x7f91c80738e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c80738e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009d90 tx=0x7f91b802bf30 comp rx=0 tx=0).stop 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 -- 172.21.15.84:0/2602712617 shutdown_connections 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c806b900 0x7f91c80c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 --2- 172.21.15.84:0/2602712617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c80738e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 -- 172.21.15.84:0/2602712617 >> 172.21.15.84:0/2602712617 conn(0x7f91c80cdc60 msgr2=0x7f91c80c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 -- 172.21.15.84:0/2602712617 shutdown_connections 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.327+0000 7f91cd405640 1 -- 172.21.15.84:0/2602712617 wait complete. 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.328+0000 7f91cd405640 1 Processor -- start 2024-04-14T10:58:04.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.328+0000 7f91cd405640 1 -- start start 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91cd405640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c806b900 0x7f91c8147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91cd405640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80c70c0 0x7f91c8148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91cd405640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c81e3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91cd405640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91c806cc90 con 0x7f91c8152ba0 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91cd405640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91c80c84d0 con 0x7f91c806b900 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91cd405640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91c806cf70 con 0x7f91c80c70c0 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c81e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c81e3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34430/0 (socket says 172.21.15.84:34430) 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 -- 172.21.15.84:0/2181266110 learned_addr learned my addr 172.21.15.84:0/2181266110 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c6ffd640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c806b900 0x7f91c8147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c67fc640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80c70c0 0x7f91c8148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 -- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80c70c0 msgr2=0x7f91c8148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80c70c0 0x7f91c8148430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 -- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c806b900 msgr2=0x7f91c8147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c806b900 0x7f91c8147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.329+0000 7f91c77fe640 1 -- 172.21.15.84:0/2181266110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8151240 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.330+0000 7f91c77fe640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c81e3380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c450 tx=0x7f91c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.330+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0018070 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.330+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91c0007500 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.330+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c8157e10 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.330+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0004a20 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.330+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c8156b10 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.331+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c814fff0 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.331+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91c001b070 con 0x7f91c8152ba0 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.331+0000 7f91af7fe640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91b406c8f0 0x7f91b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.332+0000 7f91c6ffd640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91b406c8f0 0x7f91b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.332+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f91c008add0 con 0x7f91c8152ba0 2024-04-14T10:58:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.332+0000 7f91c6ffd640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91b406c8f0 0x7f91b406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91b8036000 tx=0x7f91b8030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.336+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f91c814fff0 con 0x7f91c8152ba0 2024-04-14T10:58:04.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.513+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c8069280 con 0x7f91c8152ba0 2024-04-14T10:58:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.514+0000 7f91af7fe640 1 -- 172.21.15.84:0/2181266110 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7f91c008c090 con 0x7f91c8152ba0 2024-04-14T10:58:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:04.514 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:03.536182+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:04.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91b406c8f0 msgr2=0x7f91b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91b406c8f0 0x7f91b406edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91b8036000 tx=0x7f91b8030000 comp rx=0 tx=0).stop 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 msgr2=0x7f91c81e3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c81e3380 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91c000c450 tx=0x7f91c000c910 comp rx=0 tx=0).stop 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 shutdown_connections 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f91b406c8f0 0x7f91b406edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91c8152ba0 0x7f91c81e3380 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91c80c70c0 0x7f91c8148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 --2- 172.21.15.84:0/2181266110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91c806b900 0x7f91c8147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 >> 172.21.15.84:0/2181266110 conn(0x7f91c80cdc60 msgr2=0x7f91c80c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 shutdown_connections 2024-04-14T10:58:04.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.516+0000 7f91cd405640 1 -- 172.21.15.84:0/2181266110 wait complete. 2024-04-14T10:58:04.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.628+0000 7fd3900de640 1 Processor -- start 2024-04-14T10:58:04.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.628+0000 7fd3900de640 1 -- start start 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd3900de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd388067b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd3900de640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38815b140 con 0x7fd388154e90 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd3900de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd38815b420 con 0x7fd388067720 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd3900de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd38815bcc0 con 0x7fd3880c9070 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd38de7a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd388154e90 0x7fd38806ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34210/0 (socket says 172.21.15.84:34210) 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd38de7a640 1 -- 172.21.15.84:0/464986602 learned_addr learned my addr 172.21.15.84:0/464986602 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd38e67b640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd388067b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202729852 0 0) 0x7fd38815b140 con 0x7fd388154e90 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.629+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd374003520 con 0x7fd388154e90 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356137418 0 0) 0x7fd374003520 con 0x7fd388154e90 2024-04-14T10:58:04.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 msgr2=0x7fd388067b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd388067b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 >> v1:172.21.15.175:6789/0 conn(0x7fd388067720 legacy=0x7fd3880c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38815b700 con 0x7fd388154e90 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7fd3840019f0 con 0x7fd388154e90 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd388067b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 >> v1:172.21.15.84:6789/0 conn(0x7fd388154e90 legacy=0x7fd38806ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd3740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd374003f40 0x7fd374004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd38815bcc0 con 0x7fd374004d40 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd37400bb50 con 0x7fd374003f40 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd37400bd20 con 0x7fd3880c9070 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38de7a640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd3740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38d679640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd374003f40 0x7fd374004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 -- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 msgr2=0x7fd3740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3880c9070 0x7fd3740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 -- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd374003f40 msgr2=0x7fd374004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd374003f40 0x7fd374004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38e67b640 1 -- 172.21.15.84:0/464986602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd374003520 con 0x7fd374004d40 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.630+0000 7fd38d679640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd374003f40 0x7fd374004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd38e67b640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3740051c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd380009c90 tx=0x7fd374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cfab22fa9db04 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380039070 con 0x7fd374004d40 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd38002c8f0 con 0x7fd374004d40 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd38ce78640 1 -- 172.21.15.84:0/464986602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380009860 con 0x7fd374004d40 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd3900de640 1 -- 172.21.15.84:0/464986602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 msgr2=0x7fd3740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd3900de640 1 --2- 172.21.15.84:0/464986602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3740051c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd380009c90 tx=0x7fd374005830 comp rx=0 tx=0).stop 2024-04-14T10:58:04.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd38e67b640 1 -- 172.21.15.84:0/464986602 reap_dead start 2024-04-14T10:58:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd3900de640 1 -- 172.21.15.84:0/464986602 shutdown_connections 2024-04-14T10:58:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.631+0000 7fd3900de640 1 -- 172.21.15.84:0/464986602 >> 172.21.15.84:0/464986602 conn(0x7fd3880c9f70 msgr2=0x7fd3880ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.632+0000 7fd3900de640 1 -- 172.21.15.84:0/464986602 shutdown_connections 2024-04-14T10:58:04.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.632+0000 7fd3900de640 1 -- 172.21.15.84:0/464986602 wait complete. 2024-04-14T10:58:04.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 Processor -- start 2024-04-14T10:58:04.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 -- start start 2024-04-14T10:58:04.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3881501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd388073590 0x7fd388072850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd388157f70 0x7fd388072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd38806ba50 con 0x7fd374004d40 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3880c8440 con 0x7fd388157f70 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd3900de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd38806d150 con 0x7fd388073590 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd38de7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3881501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd38de7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3881501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34450/0 (socket says 172.21.15.84:34450) 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.633+0000 7fd38de7a640 1 -- 172.21.15.84:0/1523367011 learned_addr learned my addr 172.21.15.84:0/1523367011 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38de7a640 1 -- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd388073590 msgr2=0x7fd388072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38d679640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd388073590 0x7fd388072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38de7a640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd388073590 0x7fd388072850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38de7a640 1 -- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd388157f70 msgr2=0x7fd388072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38e67b640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd388157f70 0x7fd388072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38de7a640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd388157f70 0x7fd388072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38de7a640 1 -- 172.21.15.84:0/1523367011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd388159800 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38d679640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd388073590 0x7fd388072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38e67b640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd388157f70 0x7fd388072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd38de7a640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3881501e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd384007970 tx=0x7fd38400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384017020 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3840133f0 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd388159a90 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384013800 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.634+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38815a050 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.635+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd388069c30 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.635+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd38401a020 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.636+0000 7fd37e7fc640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd36c06c8f0 0x7fd36c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.636+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fd38408c8e0 con 0x7fd374004d40 2024-04-14T10:58:04.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.636+0000 7fd38d679640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd36c06c8f0 0x7fd36c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.636+0000 7fd38d679640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd36c06c8f0 0x7fd36c06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3881549a0 tx=0x7fd378009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.640+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fd384021020 con 0x7fd374004d40 2024-04-14T10:58:04.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.816+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3880c4410 con 0x7fd374004d40 2024-04-14T10:58:04.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.817+0000 7fd37e7fc640 1 -- 172.21.15.84:0/1523367011 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16594 (secure 0 0 0) 0x7fd38405ada0 con 0x7fd374004d40 2024-04-14T10:58:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:04.817 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":19,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:03.536182+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd36c06c8f0 msgr2=0x7fd36c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd36c06c8f0 0x7fd36c06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3881549a0 tx=0x7fd378009040 comp rx=0 tx=0).stop 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 msgr2=0x7fd3881501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3881501e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd384007970 tx=0x7fd38400a730 comp rx=0 tx=0).stop 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 shutdown_connections 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd36c06c8f0 0x7fd36c06edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd388157f70 0x7fd388072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd388073590 0x7fd388072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 --2- 172.21.15.84:0/1523367011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd374004d40 0x7fd3881501e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 >> 172.21.15.84:0/1523367011 conn(0x7fd3880c9f70 msgr2=0x7fd38806fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:04.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 shutdown_connections 2024-04-14T10:58:04.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.819+0000 7fd3900de640 1 -- 172.21.15.84:0/1523367011 wait complete. 2024-04-14T10:58:04.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T10:58:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.933+0000 7fbcec111640 1 Processor -- start 2024-04-14T10:58:04.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.934+0000 7fbcec111640 1 -- start start 2024-04-14T10:58:04.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.934+0000 7fbcec111640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbce40c3590 0x7fbce415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.934+0000 7fbcec111640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce40c4340 con 0x7fbce40cb000 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.934+0000 7fbcec111640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce40c4620 con 0x7fbce41530f0 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.934+0000 7fbcec111640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbce40c4900 con 0x7fbce40c3590 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbce40cb000 0x7fbce4163520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34220/0 (socket says 172.21.15.84:34220) 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 -- 172.21.15.84:0/347973361 learned_addr learned my addr 172.21.15.84:0/347973361 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce96ac640 1 --2- 172.21.15.84:0/347973361 >> v2:172.21.15.175:3300/0 conn(0x7fbce40c3590 0x7fbce415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733800592 0 0) 0x7fbce40c4340 con 0x7fbce40cb000 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd0003520 con 0x7fbce40cb000 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4227895343 0 0) 0x7fbcd0003520 con 0x7fbce40cb000 2024-04-14T10:58:04.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 >> v2:172.21.15.175:3300/0 conn(0x7fbce40c3590 msgr2=0x7fbce415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 --2- 172.21.15.84:0/347973361 >> v2:172.21.15.175:3300/0 conn(0x7fbce40c3590 0x7fbce415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 >> v1:172.21.15.175:6789/0 conn(0x7fbce41530f0 legacy=0x7fbce40c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce415c230 con 0x7fbce40cb000 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7fbcdc0019f0 con 0x7fbce40cb000 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 >> v1:172.21.15.84:6789/0 conn(0x7fbce40cb000 legacy=0x7fbce4163520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcd00039b0 0x7fbcd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcd0004800 0x7fbcd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbcd000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40c4900 con 0x7fbcd00051c0 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd000c060 con 0x7fbcd00039b0 2024-04-14T10:58:04.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd000c260 con 0x7fbcd0004800 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbcd000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce9ead640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcd00039b0 0x7fbcd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbce96ac640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcd0004800 0x7fbcd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 -- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcd0004800 msgr2=0x7fbcd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbcd0004800 0x7fbcd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 -- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcd00039b0 msgr2=0x7fbcd0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbcd00039b0 0x7fbcd0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.935+0000 7fbcea6ae640 1 -- 172.21.15.84:0/347973361 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd0003520 con 0x7fbcd00051c0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.936+0000 7fbcea6ae640 1 -- 172.21.15.84:0/347973361 reap_dead start 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.936+0000 7fbcea6ae640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbcd000b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00a840 tx=0x7fbcd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad8568636d0960a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.936+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00a460 con 0x7fbcd00051c0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.936+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcdc034670 con 0x7fbcd00051c0 2024-04-14T10:58:04.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.936+0000 7fbce8eab640 1 -- 172.21.15.84:0/347973361 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc034a60 con 0x7fbcd00051c0 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 -- 172.21.15.84:0/347973361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 msgr2=0x7fbcd000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbcd000b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00a840 tx=0x7fbcd0005830 comp rx=0 tx=0).stop 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 -- 172.21.15.84:0/347973361 shutdown_connections 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 --2- 172.21.15.84:0/347973361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbcd000b9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 -- 172.21.15.84:0/347973361 >> 172.21.15.84:0/347973361 conn(0x7fbce40ce570 msgr2=0x7fbce40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 -- 172.21.15.84:0/347973361 shutdown_connections 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.937+0000 7fbcec111640 1 -- 172.21.15.84:0/347973361 wait complete. 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.938+0000 7fbcec111640 1 Processor -- start 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.938+0000 7fbcec111640 1 -- start start 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbce41e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce41535c0 0x7fbce41550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbce40b2f70 0x7fbce40b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbce40c4be0 con 0x7fbcd00051c0 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbce406f6e0 con 0x7fbce41535c0 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbce40c4d60 con 0x7fbce40b2f70 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbce41e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbce41e16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34470/0 (socket says 172.21.15.84:34470) 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 -- 172.21.15.84:0/43082131 learned_addr learned my addr 172.21.15.84:0/43082131 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcea6ae640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbce40b2f70 0x7fbce40b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce96ac640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce41535c0 0x7fbce41550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 -- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbce40b2f70 msgr2=0x7fbce40b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbce40b2f70 0x7fbce40b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 -- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce41535c0 msgr2=0x7fbce41550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce41535c0 0x7fbce41550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 -- 172.21.15.84:0/43082131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce40b3930 con 0x7fbcd00051c0 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcea6ae640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbce40b2f70 0x7fbce40b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbce9ead640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbce41e16b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400f5f0 tx=0x7fbcd400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40052e0 con 0x7fbcd00051c0 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd4018070 con 0x7fbcd00051c0 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce40b44a0 con 0x7fbcd00051c0 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4003810 con 0x7fbcd00051c0 2024-04-14T10:58:04.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.939+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce40b2490 con 0x7fbcd00051c0 2024-04-14T10:58:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.940+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce40c9960 con 0x7fbcd00051c0 2024-04-14T10:58:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.941+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcd40039b0 con 0x7fbcd00051c0 2024-04-14T10:58:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.941+0000 7fbcda7fc640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbcc806c8f0 0x7fbcc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.941+0000 7fbce96ac640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbcc806c8f0 0x7fbcc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.941+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fbcd408b8e0 con 0x7fbcd00051c0 2024-04-14T10:58:04.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.942+0000 7fbce96ac640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbcc806c8f0 0x7fbcc806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ccc20 tx=0x7fbce0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:04.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:04.946+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fbce40b3930 con 0x7fbcd00051c0 2024-04-14T10:58:05.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.159+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbce4069b00 con 0x7fbcd00051c0 2024-04-14T10:58:05.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.204+0000 7fbcda7fc640 1 -- 172.21.15.84:0/43082131 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fbcd4059d10 con 0x7fbcd00051c0 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbcc806c8f0 msgr2=0x7fbcc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbcc806c8f0 0x7fbcc806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ccc20 tx=0x7fbce0008040 comp rx=0 tx=0).stop 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 msgr2=0x7fbce41e16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbce41e16b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400f5f0 tx=0x7fbcd400fab0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 shutdown_connections 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbcc806c8f0 0x7fbcc806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbce40b2f70 0x7fbce40b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbce41535c0 0x7fbce41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 --2- 172.21.15.84:0/43082131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbcd00051c0 0x7fbce41e16b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 >> 172.21.15.84:0/43082131 conn(0x7fbce40ce570 msgr2=0x7fbce40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 shutdown_connections 2024-04-14T10:58:05.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.206+0000 7fbcec111640 1 -- 172.21.15.84:0/43082131 wait complete. 2024-04-14T10:58:05.216 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2024-04-14T10:58:05.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-14T10:58:05.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.320+0000 7fd8204c8640 1 Processor -- start 2024-04-14T10:58:05.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.320+0000 7fd8204c8640 1 -- start start 2024-04-14T10:58:05.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd8204c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 0x7fd81806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd8204c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd81815bd80 0x7fd8180c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd8204c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd81806cf80 0x7fd8180c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd8204c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fd81815b050 con 0x7fd81806cf80 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd8204c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd81815b8f0 con 0x7fd81815bd80 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd8204c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd8180c9750 con 0x7fd818151e00 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd81ea65640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd81806cf80 0x7fd8180c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd81ea65640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd81806cf80 0x7fd8180c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34480/0 (socket says 172.21.15.84:34480) 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.321+0000 7fd81ea65640 1 -- 172.21.15.84:0/2728032667 learned_addr learned my addr 172.21.15.84:0/2728032667 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81ea65640 1 -- 172.21.15.84:0/2728032667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 msgr2=0x7fd81806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81ea65640 1 --2- 172.21.15.84:0/2728032667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 0x7fd81806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81ea65640 1 -- 172.21.15.84:0/2728032667 >> v2:172.21.15.175:3300/0 conn(0x7fd81815bd80 msgr2=0x7fd8180c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81ea65640 1 --2- 172.21.15.84:0/2728032667 >> v2:172.21.15.175:3300/0 conn(0x7fd81815bd80 0x7fd8180c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81ea65640 1 -- 172.21.15.84:0/2728032667 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8180c99f0 con 0x7fd81806cf80 2024-04-14T10:58:05.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81ea65640 1 --2- 172.21.15.84:0/2728032667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81806cf80 0x7fd8180c8d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd818070ce0 tx=0x7fd81002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3f483260408d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:05.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81d262640 1 -- 172.21.15.84:0/2728032667 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810034070 con 0x7fd81806cf80 2024-04-14T10:58:05.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81d262640 1 -- 172.21.15.84:0/2728032667 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810030860 con 0x7fd81806cf80 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.322+0000 7fd81d262640 1 -- 172.21.15.84:0/2728032667 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810030c30 con 0x7fd81806cf80 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 -- 172.21.15.84:0/2728032667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81806cf80 msgr2=0x7fd8180c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 --2- 172.21.15.84:0/2728032667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81806cf80 0x7fd8180c8d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd818070ce0 tx=0x7fd81002b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 -- 172.21.15.84:0/2728032667 shutdown_connections 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 --2- 172.21.15.84:0/2728032667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81806cf80 0x7fd8180c8d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 --2- 172.21.15.84:0/2728032667 >> v2:172.21.15.175:3300/0 conn(0x7fd81815bd80 0x7fd8180c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 --2- 172.21.15.84:0/2728032667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 0x7fd81806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 -- 172.21.15.84:0/2728032667 >> 172.21.15.84:0/2728032667 conn(0x7fd8180cdb80 msgr2=0x7fd818070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 -- 172.21.15.84:0/2728032667 shutdown_connections 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.323+0000 7fd8204c8640 1 -- 172.21.15.84:0/2728032667 wait complete. 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.324+0000 7fd8204c8640 1 Processor -- start 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.324+0000 7fd8204c8640 1 -- start start 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd8204c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81806cf80 0x7fd818142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd8204c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 0x7fd8180ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd8204c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 0x7fd818145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd8204c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd81815b580 con 0x7fd81815bd80 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd8204c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd81815b2a0 con 0x7fd81806cf80 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd8204c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd81806be40 con 0x7fd818151e00 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 0x7fd818145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 0x7fd818145290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34494/0 (socket says 172.21.15.84:34494) 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 -- 172.21.15.84:0/4285201076 learned_addr learned my addr 172.21.15.84:0/4285201076 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 -- 172.21.15.84:0/4285201076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 msgr2=0x7fd8180ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 0x7fd8180ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 -- 172.21.15.84:0/4285201076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81806cf80 msgr2=0x7fd818142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81806cf80 0x7fd818142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 -- 172.21.15.84:0/4285201076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8180cd210 con 0x7fd81815bd80 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.325+0000 7fd81ea65640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 0x7fd818145290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd81002b9e0 tx=0x7fd810004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.326+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810048070 con 0x7fd81815bd80 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.326+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd810030660 con 0x7fd81815bd80 2024-04-14T10:58:05.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.326+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd818146810 con 0x7fd81815bd80 2024-04-14T10:58:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.326+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810034040 con 0x7fd81815bd80 2024-04-14T10:58:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.326+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8180cc890 con 0x7fd81815bd80 2024-04-14T10:58:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.326+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8181521e0 con 0x7fd81815bd80 2024-04-14T10:58:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.327+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd81004b070 con 0x7fd81815bd80 2024-04-14T10:58:05.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.327+0000 7fd80effd640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7fc06c8f0 0x7fd7fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:05.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.327+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd8100adcc0 con 0x7fd81815bd80 2024-04-14T10:58:05.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.327+0000 7fd81e264640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7fc06c8f0 0x7fd7fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:05.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.328+0000 7fd81e264640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7fc06c8f0 0x7fd7fc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd81400ab90 tx=0x7fd814009250 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:05.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.332+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fd8181521e0 con 0x7fd81815bd80 2024-04-14T10:58:05.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:05.546+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fd818069b20 con 0x7fd81815bd80 2024-04-14T10:58:06.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.208+0000 7fd80effd640 1 -- 172.21.15.84:0/4285201076 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7fd81007c180 con 0x7fd81815bd80 2024-04-14T10:58:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7fc06c8f0 msgr2=0x7fd7fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7fc06c8f0 0x7fd7fc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd81400ab90 tx=0x7fd814009250 comp rx=0 tx=0).stop 2024-04-14T10:58:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 msgr2=0x7fd818145290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:06.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 0x7fd818145290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd81002b9e0 tx=0x7fd810004730 comp rx=0 tx=0).stop 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 shutdown_connections 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7fc06c8f0 0x7fd7fc06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd81815bd80 0x7fd818145290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd818151e00 0x7fd8180ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 --2- 172.21.15.84:0/4285201076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd81806cf80 0x7fd818142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 >> 172.21.15.84:0/4285201076 conn(0x7fd8180cdb80 msgr2=0x7fd818147020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 shutdown_connections 2024-04-14T10:58:06.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.211+0000 7fd8204c8640 1 -- 172.21.15.84:0/4285201076 wait complete. 2024-04-14T10:58:06.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T10:58:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.328+0000 7ffa82b5e640 1 Processor -- start 2024-04-14T10:58:06.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.328+0000 7ffa82b5e640 1 -- start start 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa82b5e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa7c152a00 0x7ffa7c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa82b5e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa7c0c7f50 0x7ffa7c0733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa82b5e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7c0c73c0 con 0x7ffa7c0c83c0 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa82b5e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7c06b900 con 0x7ffa7c152a00 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa82b5e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7c06bbe0 con 0x7ffa7c0c7f50 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa7c152a00 0x7ffa7c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:06.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ffa7c152a00 0x7ffa7c0c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34500/0 (socket says 172.21.15.84:34500) 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 -- 172.21.15.84:0/4203169345 learned_addr learned my addr 172.21.15.84:0/4203169345 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa7bfff640 1 --2- 172.21.15.84:0/4203169345 >> v2:172.21.15.175:3300/0 conn(0x7ffa7c0c7f50 0x7ffa7c0733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 -- 172.21.15.84:0/4203169345 >> v2:172.21.15.175:3300/0 conn(0x7ffa7c0c7f50 msgr2=0x7ffa7c0733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 --2- 172.21.15.84:0/4203169345 >> v2:172.21.15.175:3300/0 conn(0x7ffa7c0c7f50 0x7ffa7c0733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 -- 172.21.15.84:0/4203169345 >> v1:172.21.15.175:6789/0 conn(0x7ffa7c0c83c0 legacy=0x7ffa7c158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.329+0000 7ffa808fa640 1 -- 172.21.15.84:0/4203169345 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c06bec0 con 0x7ffa7c152a00 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.330+0000 7ffa808fa640 1 --2- 172.21.15.84:0/4203169345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c0c6b80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c068020 tx=0x7ffa6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec900b1a17765d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.330+0000 7ffa7b7fe640 1 -- 172.21.15.84:0/4203169345 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c034070 con 0x7ffa7c152a00 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.330+0000 7ffa7b7fe640 1 -- 172.21.15.84:0/4203169345 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c030860 con 0x7ffa7c152a00 2024-04-14T10:58:06.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.330+0000 7ffa7b7fe640 1 -- 172.21.15.84:0/4203169345 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c030c30 con 0x7ffa7c152a00 2024-04-14T10:58:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 -- 172.21.15.84:0/4203169345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 msgr2=0x7ffa7c0c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/4203169345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c0c6b80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c068020 tx=0x7ffa6c02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 -- 172.21.15.84:0/4203169345 shutdown_connections 2024-04-14T10:58:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/4203169345 >> v2:172.21.15.175:3300/0 conn(0x7ffa7c0c7f50 0x7ffa7c0733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/4203169345 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c0c6b80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 -- 172.21.15.84:0/4203169345 >> 172.21.15.84:0/4203169345 conn(0x7ffa7c067b40 msgr2=0x7ffa7c070570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 -- 172.21.15.84:0/4203169345 shutdown_connections 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.331+0000 7ffa82b5e640 1 -- 172.21.15.84:0/4203169345 wait complete. 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.332+0000 7ffa82b5e640 1 Processor -- start 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.332+0000 7ffa82b5e640 1 -- start start 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa82b5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa7c0c7f50 0x7ffa7c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa82b5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7c0c83c0 0x7ffa7c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa82b5e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa82b5e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c0c70c0 con 0x7ffa7c152a00 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa82b5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7c06c480 con 0x7ffa7c0c7f50 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa82b5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7c152de0 con 0x7ffa7c0c83c0 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34510/0 (socket says 172.21.15.84:34510) 2024-04-14T10:58:06.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 -- 172.21.15.84:0/218501969 learned_addr learned my addr 172.21.15.84:0/218501969 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa7bfff640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7c0c83c0 0x7ffa7c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa808fa640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa7c0c7f50 0x7ffa7c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 -- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7c0c83c0 msgr2=0x7ffa7c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7c0c83c0 0x7ffa7c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 -- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa7c0c7f50 msgr2=0x7ffa7c150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa7c0c7f50 0x7ffa7c150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 -- 172.21.15.84:0/218501969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7c0cd080 con 0x7ffa7c152a00 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa810fb640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c147ed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c730 tx=0x7ffa7400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.333+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74016020 con 0x7ffa7c152a00 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.334+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa7400aa50 con 0x7ffa7c152a00 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.334+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa7c1ee5c0 con 0x7ffa7c152a00 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.334+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ce40 con 0x7ffa7c152a00 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.334+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7c1eeb80 con 0x7ffa7c152a00 2024-04-14T10:58:06.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.334+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7c069b00 con 0x7ffa7c152a00 2024-04-14T10:58:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.335+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa74019020 con 0x7ffa7c152a00 2024-04-14T10:58:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.335+0000 7ffa797fa640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ffa6806c8f0 0x7ffa6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:06.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.335+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffa7408bb80 con 0x7ffa7c152a00 2024-04-14T10:58:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.335+0000 7ffa808fa640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ffa6806c8f0 0x7ffa6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:06.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.336+0000 7ffa808fa640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ffa6806c8f0 0x7ffa6806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c036000 tx=0x7ffa6c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:06.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.340+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ffa74020030 con 0x7ffa7c152a00 2024-04-14T10:58:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:06.555+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffa7c14b9a0 con 0x7ffa7c152a00 2024-04-14T10:58:07.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.211+0000 7ffa797fa640 1 -- 172.21.15.84:0/218501969 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7ffa740182c0 con 0x7ffa7c152a00 2024-04-14T10:58:07.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ffa6806c8f0 msgr2=0x7ffa6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ffa6806c8f0 0x7ffa6806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c036000 tx=0x7ffa6c03b040 comp rx=0 tx=0).stop 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 msgr2=0x7ffa7c147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c147ed0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c730 tx=0x7ffa7400cbf0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 shutdown_connections 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ffa6806c8f0 0x7ffa6806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa7c152a00 0x7ffa7c147ed0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa7c0c83c0 0x7ffa7c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 --2- 172.21.15.84:0/218501969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa7c0c7f50 0x7ffa7c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 >> 172.21.15.84:0/218501969 conn(0x7ffa7c067b40 msgr2=0x7ffa7c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 shutdown_connections 2024-04-14T10:58:07.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.213+0000 7ffa82b5e640 1 -- 172.21.15.84:0/218501969 wait complete. 2024-04-14T10:58:07.225 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-14T10:58:07.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.334+0000 7ff20c2de640 1 Processor -- start 2024-04-14T10:58:07.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.334+0000 7ff20c2de640 1 -- start start 2024-04-14T10:58:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20c2de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 0x7ff20415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20c2de640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff20415d3c0 con 0x7ff2040ca530 2024-04-14T10:58:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20c2de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2040caa90 con 0x7ff20406c420 2024-04-14T10:58:07.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20c2de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff204159ba0 con 0x7ff204153290 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20a87b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff2040ca530 0x7ff2040c3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34228/0 (socket says 172.21.15.84:34228) 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20a87b640 1 -- 172.21.15.84:0/1301746718 learned_addr learned my addr 172.21.15.84:0/1301746718 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff20a07a640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 0x7ff20415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170576975 0 0) 0x7ff20415d3c0 con 0x7ff2040ca530 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1f0003520 con 0x7ff2040ca530 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 574901386 0 0) 0x7ff1f0003520 con 0x7ff2040ca530 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 msgr2=0x7ff20415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 0x7ff20415ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 >> v1:172.21.15.175:6789/0 conn(0x7ff20406c420 legacy=0x7ff20406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff204158f90 con 0x7ff2040ca530 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.335+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7ff1fc001670 con 0x7ff2040ca530 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 >> v1:172.21.15.84:6789/0 conn(0x7ff2040ca530 legacy=0x7ff2040c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 0x7ff1f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f0003f20 0x7ff1f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1f0004d40 0x7ff1f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f000b9f0 con 0x7ff1f0004d40 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f000bba0 con 0x7ff1f0003f20 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f000bda0 con 0x7ff204153290 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a87b640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1f0004d40 0x7ff1f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a07a640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 0x7ff1f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff209879640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f0003f20 0x7ff1f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a87b640 1 -- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 msgr2=0x7ff1f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a87b640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff204153290 0x7ff1f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a87b640 1 -- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f0003f20 msgr2=0x7ff1f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a87b640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f0003f20 0x7ff1f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.336+0000 7ff20a87b640 1 -- 172.21.15.84:0/1301746718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f0003520 con 0x7ff1f0004d40 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20a87b640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1f0004d40 0x7ff1f00051c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c210 tx=0x7ff1f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654e296047c5c5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc007d30 con 0x7ff1f0004d40 2024-04-14T10:58:07.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc030070 con 0x7ff1f0004d40 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff209078640 1 -- 172.21.15.84:0/1301746718 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc005d70 con 0x7ff1f0004d40 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20c2de640 1 -- 172.21.15.84:0/1301746718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1f0004d40 msgr2=0x7ff1f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20c2de640 1 --2- 172.21.15.84:0/1301746718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1f0004d40 0x7ff1f00051c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00c210 tx=0x7ff1f0005830 comp rx=0 tx=0).stop 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20a87b640 1 -- 172.21.15.84:0/1301746718 reap_dead start 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20c2de640 1 -- 172.21.15.84:0/1301746718 shutdown_connections 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20c2de640 1 -- 172.21.15.84:0/1301746718 >> 172.21.15.84:0/1301746718 conn(0x7ff2040c8e60 msgr2=0x7ff2040c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20c2de640 1 -- 172.21.15.84:0/1301746718 shutdown_connections 2024-04-14T10:58:07.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.337+0000 7ff20c2de640 1 -- 172.21.15.84:0/1301746718 wait complete. 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 Processor -- start 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 -- start start 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f0004d40 0x7ff2041f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff20414cf60 0x7ff2040c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 0x7ff20414ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff204159830 con 0x7ff20415b7e0 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff204159550 con 0x7ff20414cf60 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20c2de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff20406c010 con 0x7ff1f0004d40 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20a87b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 0x7ff20414ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20a87b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 0x7ff20414ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34540/0 (socket says 172.21.15.84:34540) 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20a87b640 1 -- 172.21.15.84:0/3109229636 learned_addr learned my addr 172.21.15.84:0/3109229636 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.339+0000 7ff20a07a640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f0004d40 0x7ff2041f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff209879640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff20414cf60 0x7ff2040c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20a87b640 1 -- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f0004d40 msgr2=0x7ff2041f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20a87b640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f0004d40 0x7ff2041f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20a87b640 1 -- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff20414cf60 msgr2=0x7ff2040c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20a87b640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff20414cf60 0x7ff2040c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20a87b640 1 -- 172.21.15.84:0/3109229636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2041f3360 con 0x7ff20415b7e0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20a87b640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 0x7ff20414ba70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc02c520 tx=0x7ff1fc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc007d30 con 0x7ff20415b7e0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc0049e0 con 0x7ff20415b7e0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20415bd40 con 0x7ff20415b7e0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc004db0 con 0x7ff20415b7e0 2024-04-14T10:58:07.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.340+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20414af90 con 0x7ff20415b7e0 2024-04-14T10:58:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.341+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff204068b70 con 0x7ff20415b7e0 2024-04-14T10:58:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.341+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1fc007070 con 0x7ff20415b7e0 2024-04-14T10:58:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.342+0000 7ff1faffd640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1e806c8f0 0x7ff1e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.342+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff1fc0acb90 con 0x7ff20415b7e0 2024-04-14T10:58:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.342+0000 7ff20a07a640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1e806c8f0 0x7ff1e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:07.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.342+0000 7ff20a07a640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1e806c8f0 0x7ff1e806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff20415b4c0 tx=0x7ff20000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:07.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.346+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff204068b70 con 0x7ff20415b7e0 2024-04-14T10:58:07.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:07.561+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7ff2040c9770 con 0x7ff20415b7e0 2024-04-14T10:58:08.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.219+0000 7ff1faffd640 1 -- 172.21.15.84:0/3109229636 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) ==== 115+0+0 (secure 0 0 0) 0x7ff2040c9770 con 0x7ff20415b7e0 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1e806c8f0 msgr2=0x7ff1e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1e806c8f0 0x7ff1e806edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff20415b4c0 tx=0x7ff20000b040 comp rx=0 tx=0).stop 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 msgr2=0x7ff20414ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 0x7ff20414ba70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc02c520 tx=0x7ff1fc02e070 comp rx=0 tx=0).stop 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 shutdown_connections 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1e806c8f0 0x7ff1e806edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff20415b7e0 0x7ff20414ba70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff20414cf60 0x7ff2040c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 --2- 172.21.15.84:0/3109229636 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f0004d40 0x7ff2041f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 >> 172.21.15.84:0/3109229636 conn(0x7ff2040c8e60 msgr2=0x7ff204151480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 shutdown_connections 2024-04-14T10:58:08.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.222+0000 7ff20c2de640 1 -- 172.21.15.84:0/3109229636 wait complete. 2024-04-14T10:58:08.233 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T10:58:08.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.340+0000 7fde2bead640 1 Processor -- start 2024-04-14T10:58:08.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.340+0000 7fde2bead640 1 -- start start 2024-04-14T10:58:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde2bead640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 0x7fde240cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde2bead640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde240ccd90 con 0x7fde240b3930 2024-04-14T10:58:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde2bead640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2415e4d0 con 0x7fde24155160 2024-04-14T10:58:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde2bead640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fde2415e7b0 con 0x7fde2415b6d0 2024-04-14T10:58:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde29448640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fde240b3930 0x7fde2415afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34234/0 (socket says 172.21.15.84:34234) 2024-04-14T10:58:08.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde29448640 1 -- 172.21.15.84:0/1474662323 learned_addr learned my addr 172.21.15.84:0/1474662323 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde2a44a640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 0x7fde240cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934300533 0 0) 0x7fde240ccd90 con 0x7fde240b3930 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde0c003520 con 0x7fde240b3930 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3137001184 0 0) 0x7fde0c003520 con 0x7fde240b3930 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 msgr2=0x7fde240cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 0x7fde240cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 >> v1:172.21.15.175:6789/0 conn(0x7fde24155160 legacy=0x7fde240cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2415ea90 con 0x7fde240b3930 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7fde18001670 con 0x7fde240b3930 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 >> v1:172.21.15.84:6789/0 conn(0x7fde240b3930 legacy=0x7fde2415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 0x7fde0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c003f20 0x7fde0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0c004d40 0x7fde0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde2415e7b0 con 0x7fde0c004d40 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c00ba20 con 0x7fde0c003f20 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c00bc20 con 0x7fde2415b6d0 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.341+0000 7fde2a44a640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0c004d40 0x7fde0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde29c49640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 0x7fde0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde29448640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c003f20 0x7fde0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde2a44a640 1 -- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 msgr2=0x7fde0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde2a44a640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde2415b6d0 0x7fde0c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde2a44a640 1 -- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c003f20 msgr2=0x7fde0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde2a44a640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c003f20 0x7fde0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde2a44a640 1 -- 172.21.15.84:0/1474662323 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c003520 con 0x7fde0c004d40 2024-04-14T10:58:08.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.342+0000 7fde2a44a640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0c004d40 0x7fde0c0051c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009a90 tx=0x7fde0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82d29f4b989fe77 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c039070 con 0x7fde0c004d40 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c02c680 con 0x7fde0c004d40 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde28c47640 1 -- 172.21.15.84:0/1474662323 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c009690 con 0x7fde0c004d40 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2bead640 1 -- 172.21.15.84:0/1474662323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0c004d40 msgr2=0x7fde0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2bead640 1 --2- 172.21.15.84:0/1474662323 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde0c004d40 0x7fde0c0051c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009a90 tx=0x7fde0c005830 comp rx=0 tx=0).stop 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2a44a640 1 -- 172.21.15.84:0/1474662323 reap_dead start 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2bead640 1 -- 172.21.15.84:0/1474662323 shutdown_connections 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2bead640 1 -- 172.21.15.84:0/1474662323 >> 172.21.15.84:0/1474662323 conn(0x7fde2406b900 msgr2=0x7fde2406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2bead640 1 -- 172.21.15.84:0/1474662323 shutdown_connections 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.343+0000 7fde2bead640 1 -- 172.21.15.84:0/1474662323 wait complete. 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.344+0000 7fde2bead640 1 Processor -- start 2024-04-14T10:58:08.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.344+0000 7fde2bead640 1 -- start start 2024-04-14T10:58:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2bead640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 0x7fde240c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2bead640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde24156910 0x7fde241f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2bead640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde24150b20 0x7fde24150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2bead640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fde24155540 con 0x7fde240c9090 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2bead640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde2415f050 con 0x7fde24156910 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2bead640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fde240cbae0 con 0x7fde24150b20 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 0x7fde240c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 0x7fde240c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34560/0 (socket says 172.21.15.84:34560) 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 -- 172.21.15.84:0/2503234134 learned_addr learned my addr 172.21.15.84:0/2503234134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde2a44a640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde24150b20 0x7fde24150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29448640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde24156910 0x7fde241f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 -- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde24150b20 msgr2=0x7fde24150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde24150b20 0x7fde24150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 -- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde24156910 msgr2=0x7fde241f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde24156910 0x7fde241f0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 -- 172.21.15.84:0/2503234134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde240ca160 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.345+0000 7fde29c49640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 0x7fde240c9470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde1400fbc0 tx=0x7fde1400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.346+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400dbd0 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.346+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14018070 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.346+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde240c8710 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.346+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14003970 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.346+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde240c9e80 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.347+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde24154cc0 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.347+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde14003b10 con 0x7fde240c9090 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.347+0000 7fde227fc640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fde1006c8f0 0x7fde1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.347+0000 7fde29448640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fde1006c8f0 0x7fde1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.347+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fde1408bd60 con 0x7fde240c9090 2024-04-14T10:58:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.348+0000 7fde29448640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fde1006c8f0 0x7fde1006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fde2415b0e0 tx=0x7fde18009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.352+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fde24154cc0 con 0x7fde240c9090 2024-04-14T10:58:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.565+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde24069c30 con 0x7fde240c9090 2024-04-14T10:58:08.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.565+0000 7fde227fc640 1 -- 172.21.15.84:0/2503234134 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6822 (secure 0 0 0) 0x7fde1405a220 con 0x7fde240c9090 2024-04-14T10:58:08.564 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:08.564 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4303,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:07.561819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-14T10:58:08.564 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.567+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fde1006c8f0 msgr2=0x7fde1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.567+0000 7fde2bead640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fde1006c8f0 0x7fde1006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fde2415b0e0 tx=0x7fde18009040 comp rx=0 tx=0).stop 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.567+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 msgr2=0x7fde240c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.567+0000 7fde2bead640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 0x7fde240c9470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde1400fbc0 tx=0x7fde1400d520 comp rx=0 tx=0).stop 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 shutdown_connections 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fde1006c8f0 0x7fde1006edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde24150b20 0x7fde24150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde24156910 0x7fde241f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 --2- 172.21.15.84:0/2503234134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fde240c9090 0x7fde240c9470 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 >> 172.21.15.84:0/2503234134 conn(0x7fde2406b900 msgr2=0x7fde240b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 shutdown_connections 2024-04-14T10:58:08.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.568+0000 7fde2bead640 1 -- 172.21.15.84:0/2503234134 wait complete. 2024-04-14T10:58:08.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.678+0000 7f84e8460640 1 Processor -- start 2024-04-14T10:58:08.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.678+0000 7f84e8460640 1 -- start start 2024-04-14T10:58:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e8460640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f84e0072f40 0x7f84e00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e8460640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84e015b350 0x7f84e015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e8460640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e006eb80 con 0x7f84e015af70 2024-04-14T10:58:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e8460640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f84e00c37d0 con 0x7f84e0072f40 2024-04-14T10:58:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e8460640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f84e00c3a90 con 0x7f84e015b350 2024-04-14T10:58:08.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f84e0072f40 0x7f84e00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f84e0072f40 0x7f84e00c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34570/0 (socket says 172.21.15.84:34570) 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 -- 172.21.15.84:0/1865007972 learned_addr learned my addr 172.21.15.84:0/1865007972 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e69fd640 1 --2- 172.21.15.84:0/1865007972 >> v2:172.21.15.175:3300/0 conn(0x7f84e015b350 0x7f84e015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 -- 172.21.15.84:0/1865007972 >> v2:172.21.15.175:3300/0 conn(0x7f84e015b350 msgr2=0x7f84e015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 --2- 172.21.15.84:0/1865007972 >> v2:172.21.15.175:3300/0 conn(0x7f84e015b350 0x7f84e015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 -- 172.21.15.84:0/1865007972 >> v1:172.21.15.175:6789/0 conn(0x7f84e015af70 legacy=0x7f84e0072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.679+0000 7f84e59fb640 1 -- 172.21.15.84:0/1865007972 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e00c3d70 con 0x7f84e0072f40 2024-04-14T10:58:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.680+0000 7f84e59fb640 1 --2- 172.21.15.84:0/1865007972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00c8710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84e00684d0 tx=0x7f84d002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9782ddfac36e0283 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.680+0000 7f84e51fa640 1 -- 172.21.15.84:0/1865007972 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d002f850 con 0x7f84e0072f40 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.680+0000 7f84e51fa640 1 -- 172.21.15.84:0/1865007972 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d002f9f0 con 0x7f84e0072f40 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.680+0000 7f84e51fa640 1 -- 172.21.15.84:0/1865007972 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d002fdc0 con 0x7f84e0072f40 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 -- 172.21.15.84:0/1865007972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 msgr2=0x7f84e00c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 --2- 172.21.15.84:0/1865007972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00c8710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f84e00684d0 tx=0x7f84d002ba30 comp rx=0 tx=0).stop 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 -- 172.21.15.84:0/1865007972 shutdown_connections 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 --2- 172.21.15.84:0/1865007972 >> v2:172.21.15.175:3300/0 conn(0x7f84e015b350 0x7f84e015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 --2- 172.21.15.84:0/1865007972 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00c8710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 -- 172.21.15.84:0/1865007972 >> 172.21.15.84:0/1865007972 conn(0x7f84e00cc150 msgr2=0x7f84e00cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 -- 172.21.15.84:0/1865007972 shutdown_connections 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.681+0000 7f84e8460640 1 -- 172.21.15.84:0/1865007972 wait complete. 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 Processor -- start 2024-04-14T10:58:08.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 -- start start 2024-04-14T10:58:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e015af70 0x7f84e0150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e015b350 0x7f84e013cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00c6480 con 0x7f84e0072f40 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00c61a0 con 0x7f84e015b350 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.682+0000 7f84e8460640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f84e015bd00 con 0x7f84e015af70 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00ca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34582/0 (socket says 172.21.15.84:34582) 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 -- 172.21.15.84:0/2245695764 learned_addr learned my addr 172.21.15.84:0/2245695764 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e59fb640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e015af70 0x7f84e0150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e69fd640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e015b350 0x7f84e013cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 -- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e015af70 msgr2=0x7f84e0150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e015af70 0x7f84e0150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 -- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e015b350 msgr2=0x7f84e013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e015b350 0x7f84e013cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 -- 172.21.15.84:0/2245695764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e01eedc0 con 0x7f84e0072f40 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e69fd640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e015b350 0x7f84e013cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e61fc640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00ca030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00c430 tx=0x7f84dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0052d0 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc005490 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc007260 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e01ef920 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.683+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01ef360 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.684+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e0069c30 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.685+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84dc007400 con 0x7f84e0072f40 2024-04-14T10:58:08.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.685+0000 7f84d6ffd640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84c406c8f0 0x7f84c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.685+0000 7f84e59fb640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84c406c8f0 0x7f84c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.685+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84dc08af00 con 0x7f84e0072f40 2024-04-14T10:58:08.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.685+0000 7f84e59fb640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84c406c8f0 0x7f84c406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f84d0036000 tx=0x7f84d0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.689+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f84e006eb80 con 0x7f84e0072f40 2024-04-14T10:58:08.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.865+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84e006f040 con 0x7f84e0072f40 2024-04-14T10:58:08.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.867+0000 7f84d6ffd640 1 -- 172.21.15.84:0/2245695764 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f84dc082e20 con 0x7f84e0072f40 2024-04-14T10:58:08.865 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:08.865 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84c406c8f0 msgr2=0x7f84c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84c406c8f0 0x7f84c406edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f84d0036000 tx=0x7f84d0008030 comp rx=0 tx=0).stop 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 msgr2=0x7f84e00ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00ca030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00c430 tx=0x7f84dc00c8f0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 shutdown_connections 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84c406c8f0 0x7f84c406edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84e015b350 0x7f84e013cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f84e015af70 0x7f84e0150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 --2- 172.21.15.84:0/2245695764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84e0072f40 0x7f84e00ca030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 >> 172.21.15.84:0/2245695764 conn(0x7f84e00cc150 msgr2=0x7f84e00c5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:08.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 shutdown_connections 2024-04-14T10:58:08.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.869+0000 7f84e8460640 1 -- 172.21.15.84:0/2245695764 wait complete. 2024-04-14T10:58:08.878 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T10:58:08.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:08.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.980+0000 7f4efd9aa640 1 Processor -- start 2024-04-14T10:58:08.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.980+0000 7f4efd9aa640 1 -- start start 2024-04-14T10:58:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4efd9aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4efd9aa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ef80b3930 0x7f4ef80cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4efd9aa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef80ccd90 con 0x7f4ef815afc0 2024-04-14T10:58:08.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4efd9aa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef815e4d0 con 0x7f4ef80b3930 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4efd9aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef815e7b0 con 0x7f4ef8155160 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4ef67fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ef80b3930 0x7f4ef80cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4ef77fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4ef815afc0 0x7f4ef80cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:59732/0 (socket says 172.21.15.84:59732) 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.981+0000 7f4ef77fe640 1 -- 172.21.15.84:0/1790959067 learned_addr learned my addr 172.21.15.84:0/1790959067 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/1790959067 >> v2:172.21.15.175:3300/0 conn(0x7f4ef80b3930 msgr2=0x7f4ef80cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef6ffd640 1 --2- 172.21.15.84:0/1790959067 >> v2:172.21.15.175:3300/0 conn(0x7f4ef80b3930 0x7f4ef80cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/1790959067 >> v1:172.21.15.175:6789/0 conn(0x7f4ef815afc0 legacy=0x7f4ef80cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/1790959067 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef815ea90 con 0x7f4ef8155160 2024-04-14T10:58:08.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef67fc640 1 --2- 172.21.15.84:0/1790959067 >> v2:172.21.15.175:3300/0 conn(0x7f4ef80b3930 0x7f4ef80cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:08.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef6ffd640 1 --2- 172.21.15.84:0/1790959067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80cb3d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80097a0 tx=0x7f4ee802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3693b4f35c798b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.982+0000 7f4ef5ffb640 1 -- 172.21.15.84:0/1790959067 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8034070 con 0x7f4ef8155160 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4ef5ffb640 1 -- 172.21.15.84:0/1790959067 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8030610 con 0x7f4ef8155160 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4ef5ffb640 1 -- 172.21.15.84:0/1790959067 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80309e0 con 0x7f4ef8155160 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 -- 172.21.15.84:0/1790959067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 msgr2=0x7f4ef80cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/1790959067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80cb3d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80097a0 tx=0x7f4ee802b960 comp rx=0 tx=0).stop 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 -- 172.21.15.84:0/1790959067 shutdown_connections 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/1790959067 >> v2:172.21.15.175:3300/0 conn(0x7f4ef80b3930 0x7f4ef80cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/1790959067 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80cb3d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 -- 172.21.15.84:0/1790959067 >> 172.21.15.84:0/1790959067 conn(0x7f4ef806b900 msgr2=0x7f4ef806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 -- 172.21.15.84:0/1790959067 shutdown_connections 2024-04-14T10:58:08.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.983+0000 7f4efd9aa640 1 -- 172.21.15.84:0/1790959067 wait complete. 2024-04-14T10:58:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.984+0000 7f4efd9aa640 1 Processor -- start 2024-04-14T10:58:08.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.984+0000 7f4efd9aa640 1 -- start start 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4efd9aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 0x7f4ef81f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4efd9aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4efd9aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ef815afc0 0x7f4ef8155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4efd9aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8155540 con 0x7f4ef80b3930 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4efd9aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef815f050 con 0x7f4ef815afc0 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4efd9aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef80cc860 con 0x7f4ef8155160 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 0x7f4ef81f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 0x7f4ef81f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34586/0 (socket says 172.21.15.84:34586) 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/3322141228 learned_addr learned my addr 172.21.15.84:0/3322141228 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef67fc640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef77fe640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ef815afc0 0x7f4ef8155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 msgr2=0x7f4ef80b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ef815afc0 msgr2=0x7f4ef8155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ef815afc0 0x7f4ef8155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.985+0000 7f4ef6ffd640 1 -- 172.21.15.84:0/3322141228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef8157480 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.986+0000 7f4ef6ffd640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 0x7f4ef81f1240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098c0 tx=0x7f4ee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.986+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8048070 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.986+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee8030410 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.986+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef8157760 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.986+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8034040 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.986+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef8157d20 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.987+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef8069c30 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.987+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ee804b070 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.988+0000 7f4edffff640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4ee406c920 0x7f4ee406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.988+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ee80ad270 con 0x7f4ef80b3930 2024-04-14T10:58:08.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.988+0000 7f4ef67fc640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4ee406c920 0x7f4ee406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:08.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.988+0000 7f4ef67fc640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4ee406c920 0x7f4ee406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009560 tx=0x7f4eec009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:08.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:08.992+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f4ee80305e0 con 0x7f4ef80b3930 2024-04-14T10:58:09.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.165+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4ef80cbf30 con 0x7f4ee406c920 2024-04-14T10:58:09.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.171+0000 7f4edffff640 1 -- 172.21.15.84:0/3322141228 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251850 (secure 0 0 0) 0x7f4ef80cbf30 con 0x7f4ee406c920 2024-04-14T10:58:09.172 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:09.174 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4ee406c920 msgr2=0x7f4ee406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4ee406c920 0x7f4ee406ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009560 tx=0x7f4eec009190 comp rx=0 tx=0).stop 2024-04-14T10:58:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 msgr2=0x7f4ef81f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 0x7f4ef81f1240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80098c0 tx=0x7f4ee80046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 shutdown_connections 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4ee406c920 0x7f4ee406ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ef815afc0 0x7f4ef8155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ef8155160 0x7f4ef80b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 --2- 172.21.15.84:0/3322141228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4ef80b3930 0x7f4ef81f1240 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 >> 172.21.15.84:0/3322141228 conn(0x7f4ef806b900 msgr2=0x7f4ef80b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 shutdown_connections 2024-04-14T10:58:09.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.174+0000 7f4efd9aa640 1 -- 172.21.15.84:0/3322141228 wait complete. 2024-04-14T10:58:09.183 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-14T10:58:07.402405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2826240,"data_stored":1748208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.227548"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571509+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:05.571509+0000","last_peered":"2024-04-14T10:58:05.571509+0000","last_clean":"2024-04-14T10:58:05.571509+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:05.571509+0000","last_undegraded":"2024-04-14T10:58:05.571509+0000","last_fullsized":"2024-04-14T10:58:05.571509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571558+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:05.571558+0000","last_peered":"2024-04-14T10:58:05.571558+0000","last_clean":"2024-04-14T10:58:05.571558+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:05.571558+0000","last_undegraded":"2024-04-14T10:58:05.571558+0000","last_fullsized":"2024-04-14T10:58:05.571558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571212+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:05.571212+0000","last_peered":"2024-04-14T10:58:05.571212+0000","last_clean":"2024-04-14T10:58:05.571212+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:05.571212+0000","last_undegraded":"2024-04-14T10:58:05.571212+0000","last_fullsized":"2024-04-14T10:58:05.571212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202831+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:05.202831+0000","last_peered":"2024-04-14T10:58:05.202831+0000","last_clean":"2024-04-14T10:58:05.202831+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:05.202831+0000","last_undegraded":"2024-04-14T10:58:05.202831+0000","last_fullsized":"2024-04-14T10:58:05.202831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571625+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:05.571625+0000","last_peered":"2024-04-14T10:58:05.571625+0000","last_clean":"2024-04-14T10:58:05.571625+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:05.571625+0000","last_undegraded":"2024-04-14T10:58:05.571625+0000","last_fullsized":"2024-04-14T10:58:05.571625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202909+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:05.202909+0000","last_peered":"2024-04-14T10:58:05.202909+0000","last_clean":"2024-04-14T10:58:05.202909+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:05.202909+0000","last_undegraded":"2024-04-14T10:58:05.202909+0000","last_fullsized":"2024-04-14T10:58:05.202909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197644+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:05.197644+0000","last_peered":"2024-04-14T10:58:05.197644+0000","last_clean":"2024-04-14T10:58:05.197644+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:05.197644+0000","last_undegraded":"2024-04-14T10:58:05.197644+0000","last_fullsized":"2024-04-14T10:58:05.197644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571620+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:05.571620+0000","last_peered":"2024-04-14T10:58:05.571620+0000","last_clean":"2024-04-14T10:58:05.571620+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:05.571620+0000","last_undegraded":"2024-04-14T10:58:05.571620+0000","last_fullsized":"2024-04-14T10:58:05.571620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336994+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:05.336994+0000","last_peered":"2024-04-14T10:58:05.336994+0000","last_clean":"2024-04-14T10:58:05.336994+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:05.336994+0000","last_undegraded":"2024-04-14T10:58:05.336994+0000","last_fullsized":"2024-04-14T10:58:05.336994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203292+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:05.203292+0000","last_peered":"2024-04-14T10:58:05.203292+0000","last_clean":"2024-04-14T10:58:05.203292+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:05.203292+0000","last_undegraded":"2024-04-14T10:58:05.203292+0000","last_fullsized":"2024-04-14T10:58:05.203292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571308+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:05.571308+0000","last_peered":"2024-04-14T10:58:05.571308+0000","last_clean":"2024-04-14T10:58:05.571308+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:05.571308+0000","last_undegraded":"2024-04-14T10:58:05.571308+0000","last_fullsized":"2024-04-14T10:58:05.571308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570968+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:05.570968+0000","last_peered":"2024-04-14T10:58:05.570968+0000","last_clean":"2024-04-14T10:58:05.570968+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:05.570968+0000","last_undegraded":"2024-04-14T10:58:05.570968+0000","last_fullsized":"2024-04-14T10:58:05.570968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203882+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:05.203882+0000","last_peered":"2024-04-14T10:58:05.203882+0000","last_clean":"2024-04-14T10:58:05.203882+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:05.203882+0000","last_undegraded":"2024-04-14T10:58:05.203882+0000","last_fullsized":"2024-04-14T10:58:05.203882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571526+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:05.571526+0000","last_peered":"2024-04-14T10:58:05.571526+0000","last_clean":"2024-04-14T10:58:05.571526+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:05.571526+0000","last_undegraded":"2024-04-14T10:58:05.571526+0000","last_fullsized":"2024-04-14T10:58:05.571526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197696+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:05.197696+0000","last_peered":"2024-04-14T10:58:05.197696+0000","last_clean":"2024-04-14T10:58:05.197696+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:05.197696+0000","last_undegraded":"2024-04-14T10:58:05.197696+0000","last_fullsized":"2024-04-14T10:58:05.197696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571568+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:05.571568+0000","last_peered":"2024-04-14T10:58:05.571568+0000","last_clean":"2024-04-14T10:58:05.571568+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:05.571568+0000","last_undegraded":"2024-04-14T10:58:05.571568+0000","last_fullsized":"2024-04-14T10:58:05.571568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202728+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:05.202728+0000","last_peered":"2024-04-14T10:58:05.202728+0000","last_clean":"2024-04-14T10:58:05.202728+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:05.202728+0000","last_undegraded":"2024-04-14T10:58:05.202728+0000","last_fullsized":"2024-04-14T10:58:05.202728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571456+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:05.571456+0000","last_peered":"2024-04-14T10:58:05.571456+0000","last_clean":"2024-04-14T10:58:05.571456+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:05.571456+0000","last_undegraded":"2024-04-14T10:58:05.571456+0000","last_fullsized":"2024-04-14T10:58:05.571456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571147+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:05.571147+0000","last_peered":"2024-04-14T10:58:05.571147+0000","last_clean":"2024-04-14T10:58:05.571147+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:05.571147+0000","last_undegraded":"2024-04-14T10:58:05.571147+0000","last_fullsized":"2024-04-14T10:58:05.571147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203427+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:05.203427+0000","last_peered":"2024-04-14T10:58:05.203427+0000","last_clean":"2024-04-14T10:58:05.203427+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:05.203427+0000","last_undegraded":"2024-04-14T10:58:05.203427+0000","last_fullsized":"2024-04-14T10:58:05.203427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572451+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:05.572451+0000","last_peered":"2024-04-14T10:58:05.572451+0000","last_clean":"2024-04-14T10:58:05.572451+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:05.572451+0000","last_undegraded":"2024-04-14T10:58:05.572451+0000","last_fullsized":"2024-04-14T10:58:05.572451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197652+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:05.197652+0000","last_peered":"2024-04-14T10:58:05.197652+0000","last_clean":"2024-04-14T10:58:05.197652+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:05.197652+0000","last_undegraded":"2024-04-14T10:58:05.197652+0000","last_fullsized":"2024-04-14T10:58:05.197652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571696+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:05.571696+0000","last_peered":"2024-04-14T10:58:05.571696+0000","last_clean":"2024-04-14T10:58:05.571696+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:05.571696+0000","last_undegraded":"2024-04-14T10:58:05.571696+0000","last_fullsized":"2024-04-14T10:58:05.571696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571306+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:05.571306+0000","last_peered":"2024-04-14T10:58:05.571306+0000","last_clean":"2024-04-14T10:58:05.571306+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:05.571306+0000","last_undegraded":"2024-04-14T10:58:05.571306+0000","last_fullsized":"2024-04-14T10:58:05.571306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197542+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:05.197542+0000","last_peered":"2024-04-14T10:58:05.197542+0000","last_clean":"2024-04-14T10:58:05.197542+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:05.197542+0000","last_undegraded":"2024-04-14T10:58:05.197542+0000","last_fullsized":"2024-04-14T10:58:05.197542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197582+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:05.197582+0000","last_peered":"2024-04-14T10:58:05.197582+0000","last_clean":"2024-04-14T10:58:05.197582+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:05.197582+0000","last_undegraded":"2024-04-14T10:58:05.197582+0000","last_fullsized":"2024-04-14T10:58:05.197582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572022+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:05.572022+0000","last_peered":"2024-04-14T10:58:05.572022+0000","last_clean":"2024-04-14T10:58:05.572022+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:05.572022+0000","last_undegraded":"2024-04-14T10:58:05.572022+0000","last_fullsized":"2024-04-14T10:58:05.572022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571930+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:05.571930+0000","last_peered":"2024-04-14T10:58:05.571930+0000","last_clean":"2024-04-14T10:58:05.571930+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:05.571930+0000","last_undegraded":"2024-04-14T10:58:05.571930+0000","last_fullsized":"2024-04-14T10:58:05.571930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572376+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:05.572376+0000","last_peered":"2024-04-14T10:58:05.572376+0000","last_clean":"2024-04-14T10:58:05.572376+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:05.572376+0000","last_undegraded":"2024-04-14T10:58:05.572376+0000","last_fullsized":"2024-04-14T10:58:05.572376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571445+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:05.571445+0000","last_peered":"2024-04-14T10:58:05.571445+0000","last_clean":"2024-04-14T10:58:05.571445+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:05.571445+0000","last_undegraded":"2024-04-14T10:58:05.571445+0000","last_fullsized":"2024-04-14T10:58:05.571445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336984+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:05.336984+0000","last_peered":"2024-04-14T10:58:05.336984+0000","last_clean":"2024-04-14T10:58:05.336984+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:05.336984+0000","last_undegraded":"2024-04-14T10:58:05.336984+0000","last_fullsized":"2024-04-14T10:58:05.336984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:09.187 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.326+0000 7fb22e8de640 1 Processor -- start 2024-04-14T10:58:09.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.326+0000 7fb22e8de640 1 -- start start 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22e8de640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2281551d0 0x7fb22806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22e8de640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb22815cdf0 0x7fb2280ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22e8de640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22815acd0 con 0x7fb2280ce320 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22e8de640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb22815af70 con 0x7fb22815cdf0 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22e8de640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb22815b210 con 0x7fb2281551d0 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22ce7b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb22815cdf0 0x7fb2280ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb2277fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fb2280ce320 0x7fb22815c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34242/0 (socket says 172.21.15.84:34242) 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb2277fe640 1 -- 172.21.15.84:0/1387316782 learned_addr learned my addr 172.21.15.84:0/1387316782 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb227fff640 1 --2- 172.21.15.84:0/1387316782 >> v2:172.21.15.175:3300/0 conn(0x7fb2281551d0 0x7fb22806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1387316782 >> v2:172.21.15.175:3300/0 conn(0x7fb2281551d0 msgr2=0x7fb22806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22ce7b640 1 --2- 172.21.15.84:0/1387316782 >> v2:172.21.15.175:3300/0 conn(0x7fb2281551d0 0x7fb22806faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1387316782 >> v1:172.21.15.84:6789/0 conn(0x7fb2280ce320 legacy=0x7fb22815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1387316782 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22815b4f0 con 0x7fb22815cdf0 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb226ffd640 1 -- 172.21.15.84:0/1387316782 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308233126 0 0) 0x7fb22815acd0 con 0x7fb2280ce320 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.327+0000 7fb227fff640 1 --2- 172.21.15.84:0/1387316782 >> v2:172.21.15.175:3300/0 conn(0x7fb2281551d0 0x7fb22806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22ce7b640 1 --2- 172.21.15.84:0/1387316782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb2280ce750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb228072df0 tx=0x7fb22002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be654982de044eb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb226ffd640 1 -- 172.21.15.84:0/1387316782 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220039070 con 0x7fb22815cdf0 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb226ffd640 1 -- 172.21.15.84:0/1387316782 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22002cd00 con 0x7fb22815cdf0 2024-04-14T10:58:09.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb226ffd640 1 -- 172.21.15.84:0/1387316782 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220034660 con 0x7fb22815cdf0 2024-04-14T10:58:09.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22e8de640 1 -- 172.21.15.84:0/1387316782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 msgr2=0x7fb2280ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1387316782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb2280ce750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb228072df0 tx=0x7fb22002bf50 comp rx=0 tx=0).stop 2024-04-14T10:58:09.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22e8de640 1 -- 172.21.15.84:0/1387316782 shutdown_connections 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1387316782 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb2280ce750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1387316782 >> v2:172.21.15.175:3300/0 conn(0x7fb2281551d0 0x7fb22806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.328+0000 7fb22e8de640 1 -- 172.21.15.84:0/1387316782 >> 172.21.15.84:0/1387316782 conn(0x7fb22806db10 msgr2=0x7fb22806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.329+0000 7fb22e8de640 1 -- 172.21.15.84:0/1387316782 shutdown_connections 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.329+0000 7fb22e8de640 1 -- 172.21.15.84:0/1387316782 wait complete. 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 Processor -- start 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 -- start start 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2280ce320 0x7fb2281e5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2281551d0 0x7fb2280cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb228151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb22815c1c0 con 0x7fb22815cdf0 2024-04-14T10:58:09.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb22815bab0 con 0x7fb2280ce320 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.330+0000 7fb22e8de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2280c8d90 con 0x7fb2281551d0 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb228151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb228151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34594/0 (socket says 172.21.15.84:34594) 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1639343704 learned_addr learned my addr 172.21.15.84:0/1639343704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb2277fe640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2281551d0 0x7fb2280cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb227fff640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2280ce320 0x7fb2281e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2281551d0 msgr2=0x7fb2280cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2281551d0 0x7fb2280cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2280ce320 msgr2=0x7fb2281e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2280ce320 0x7fb2281e5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 -- 172.21.15.84:0/1639343704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2281e4d10 con 0x7fb22815cdf0 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22ce7b640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb228151e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb220037040 tx=0x7fb220004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:09.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220044020 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22003a040 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2280ca790 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220039050 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.331+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2280cad50 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.332+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22806c850 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.332+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb220003b90 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.333+0000 7fb224ff9640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb20806c8f0 0x7fb20806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.333+0000 7fb227fff640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb20806c8f0 0x7fb20806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.333+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2200ae3f0 con 0x7fb22815cdf0 2024-04-14T10:58:09.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.333+0000 7fb227fff640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb20806c8f0 0x7fb20806edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d8b0 tx=0x7fb218008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:09.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.337+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fb22806c850 con 0x7fb22815cdf0 2024-04-14T10:58:09.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.514+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb228069c30 con 0x7fb20806c8f0 2024-04-14T10:58:09.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.520+0000 7fb224ff9640 1 -- 172.21.15.84:0/1639343704 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251850 (secure 0 0 0) 0x7fb228069c30 con 0x7fb20806c8f0 2024-04-14T10:58:09.521 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:09.523 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb20806c8f0 msgr2=0x7fb20806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb20806c8f0 0x7fb20806edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb21800d8b0 tx=0x7fb218008040 comp rx=0 tx=0).stop 2024-04-14T10:58:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 msgr2=0x7fb228151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb228151e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb220037040 tx=0x7fb220004a40 comp rx=0 tx=0).stop 2024-04-14T10:58:09.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 shutdown_connections 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb20806c8f0 0x7fb20806edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb22815cdf0 0x7fb228151e50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2281551d0 0x7fb2280cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 --2- 172.21.15.84:0/1639343704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2280ce320 0x7fb2281e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 >> 172.21.15.84:0/1639343704 conn(0x7fb22806db10 msgr2=0x7fb2280c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 shutdown_connections 2024-04-14T10:58:09.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.523+0000 7fb22e8de640 1 -- 172.21.15.84:0/1639343704 wait complete. 2024-04-14T10:58:09.534 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-14T10:58:09.402799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2826240,"data_stored":1748208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.225314"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571509+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:05.571509+0000","last_peered":"2024-04-14T10:58:05.571509+0000","last_clean":"2024-04-14T10:58:05.571509+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:05.571509+0000","last_undegraded":"2024-04-14T10:58:05.571509+0000","last_fullsized":"2024-04-14T10:58:05.571509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571558+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:05.571558+0000","last_peered":"2024-04-14T10:58:05.571558+0000","last_clean":"2024-04-14T10:58:05.571558+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:05.571558+0000","last_undegraded":"2024-04-14T10:58:05.571558+0000","last_fullsized":"2024-04-14T10:58:05.571558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571212+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:05.571212+0000","last_peered":"2024-04-14T10:58:05.571212+0000","last_clean":"2024-04-14T10:58:05.571212+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:05.571212+0000","last_undegraded":"2024-04-14T10:58:05.571212+0000","last_fullsized":"2024-04-14T10:58:05.571212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202831+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:05.202831+0000","last_peered":"2024-04-14T10:58:05.202831+0000","last_clean":"2024-04-14T10:58:05.202831+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:05.202831+0000","last_undegraded":"2024-04-14T10:58:05.202831+0000","last_fullsized":"2024-04-14T10:58:05.202831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571625+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:05.571625+0000","last_peered":"2024-04-14T10:58:05.571625+0000","last_clean":"2024-04-14T10:58:05.571625+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:05.571625+0000","last_undegraded":"2024-04-14T10:58:05.571625+0000","last_fullsized":"2024-04-14T10:58:05.571625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202909+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:05.202909+0000","last_peered":"2024-04-14T10:58:05.202909+0000","last_clean":"2024-04-14T10:58:05.202909+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:05.202909+0000","last_undegraded":"2024-04-14T10:58:05.202909+0000","last_fullsized":"2024-04-14T10:58:05.202909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197644+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:05.197644+0000","last_peered":"2024-04-14T10:58:05.197644+0000","last_clean":"2024-04-14T10:58:05.197644+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:05.197644+0000","last_undegraded":"2024-04-14T10:58:05.197644+0000","last_fullsized":"2024-04-14T10:58:05.197644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571620+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:05.571620+0000","last_peered":"2024-04-14T10:58:05.571620+0000","last_clean":"2024-04-14T10:58:05.571620+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:05.571620+0000","last_undegraded":"2024-04-14T10:58:05.571620+0000","last_fullsized":"2024-04-14T10:58:05.571620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336994+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:05.336994+0000","last_peered":"2024-04-14T10:58:05.336994+0000","last_clean":"2024-04-14T10:58:05.336994+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:05.336994+0000","last_undegraded":"2024-04-14T10:58:05.336994+0000","last_fullsized":"2024-04-14T10:58:05.336994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203292+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:05.203292+0000","last_peered":"2024-04-14T10:58:05.203292+0000","last_clean":"2024-04-14T10:58:05.203292+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:05.203292+0000","last_undegraded":"2024-04-14T10:58:05.203292+0000","last_fullsized":"2024-04-14T10:58:05.203292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571308+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:05.571308+0000","last_peered":"2024-04-14T10:58:05.571308+0000","last_clean":"2024-04-14T10:58:05.571308+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:05.571308+0000","last_undegraded":"2024-04-14T10:58:05.571308+0000","last_fullsized":"2024-04-14T10:58:05.571308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570968+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:05.570968+0000","last_peered":"2024-04-14T10:58:05.570968+0000","last_clean":"2024-04-14T10:58:05.570968+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:05.570968+0000","last_undegraded":"2024-04-14T10:58:05.570968+0000","last_fullsized":"2024-04-14T10:58:05.570968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203882+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:05.203882+0000","last_peered":"2024-04-14T10:58:05.203882+0000","last_clean":"2024-04-14T10:58:05.203882+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:05.203882+0000","last_undegraded":"2024-04-14T10:58:05.203882+0000","last_fullsized":"2024-04-14T10:58:05.203882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571526+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:05.571526+0000","last_peered":"2024-04-14T10:58:05.571526+0000","last_clean":"2024-04-14T10:58:05.571526+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:05.571526+0000","last_undegraded":"2024-04-14T10:58:05.571526+0000","last_fullsized":"2024-04-14T10:58:05.571526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197696+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:05.197696+0000","last_peered":"2024-04-14T10:58:05.197696+0000","last_clean":"2024-04-14T10:58:05.197696+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:05.197696+0000","last_undegraded":"2024-04-14T10:58:05.197696+0000","last_fullsized":"2024-04-14T10:58:05.197696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571568+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:05.571568+0000","last_peered":"2024-04-14T10:58:05.571568+0000","last_clean":"2024-04-14T10:58:05.571568+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:05.571568+0000","last_undegraded":"2024-04-14T10:58:05.571568+0000","last_fullsized":"2024-04-14T10:58:05.571568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202728+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:05.202728+0000","last_peered":"2024-04-14T10:58:05.202728+0000","last_clean":"2024-04-14T10:58:05.202728+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:05.202728+0000","last_undegraded":"2024-04-14T10:58:05.202728+0000","last_fullsized":"2024-04-14T10:58:05.202728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571456+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:05.571456+0000","last_peered":"2024-04-14T10:58:05.571456+0000","last_clean":"2024-04-14T10:58:05.571456+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:05.571456+0000","last_undegraded":"2024-04-14T10:58:05.571456+0000","last_fullsized":"2024-04-14T10:58:05.571456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571147+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:05.571147+0000","last_peered":"2024-04-14T10:58:05.571147+0000","last_clean":"2024-04-14T10:58:05.571147+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:05.571147+0000","last_undegraded":"2024-04-14T10:58:05.571147+0000","last_fullsized":"2024-04-14T10:58:05.571147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203427+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:05.203427+0000","last_peered":"2024-04-14T10:58:05.203427+0000","last_clean":"2024-04-14T10:58:05.203427+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:05.203427+0000","last_undegraded":"2024-04-14T10:58:05.203427+0000","last_fullsized":"2024-04-14T10:58:05.203427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572451+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:05.572451+0000","last_peered":"2024-04-14T10:58:05.572451+0000","last_clean":"2024-04-14T10:58:05.572451+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:05.572451+0000","last_undegraded":"2024-04-14T10:58:05.572451+0000","last_fullsized":"2024-04-14T10:58:05.572451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197652+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:05.197652+0000","last_peered":"2024-04-14T10:58:05.197652+0000","last_clean":"2024-04-14T10:58:05.197652+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:05.197652+0000","last_undegraded":"2024-04-14T10:58:05.197652+0000","last_fullsized":"2024-04-14T10:58:05.197652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571696+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:05.571696+0000","last_peered":"2024-04-14T10:58:05.571696+0000","last_clean":"2024-04-14T10:58:05.571696+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:05.571696+0000","last_undegraded":"2024-04-14T10:58:05.571696+0000","last_fullsized":"2024-04-14T10:58:05.571696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571306+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:05.571306+0000","last_peered":"2024-04-14T10:58:05.571306+0000","last_clean":"2024-04-14T10:58:05.571306+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:05.571306+0000","last_undegraded":"2024-04-14T10:58:05.571306+0000","last_fullsized":"2024-04-14T10:58:05.571306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197542+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:05.197542+0000","last_peered":"2024-04-14T10:58:05.197542+0000","last_clean":"2024-04-14T10:58:05.197542+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:05.197542+0000","last_undegraded":"2024-04-14T10:58:05.197542+0000","last_fullsized":"2024-04-14T10:58:05.197542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197582+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:05.197582+0000","last_peered":"2024-04-14T10:58:05.197582+0000","last_clean":"2024-04-14T10:58:05.197582+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:05.197582+0000","last_undegraded":"2024-04-14T10:58:05.197582+0000","last_fullsized":"2024-04-14T10:58:05.197582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572022+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:05.572022+0000","last_peered":"2024-04-14T10:58:05.572022+0000","last_clean":"2024-04-14T10:58:05.572022+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:05.572022+0000","last_undegraded":"2024-04-14T10:58:05.572022+0000","last_fullsized":"2024-04-14T10:58:05.572022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571930+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:05.571930+0000","last_peered":"2024-04-14T10:58:05.571930+0000","last_clean":"2024-04-14T10:58:05.571930+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:05.571930+0000","last_undegraded":"2024-04-14T10:58:05.571930+0000","last_fullsized":"2024-04-14T10:58:05.571930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572376+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:05.572376+0000","last_peered":"2024-04-14T10:58:05.572376+0000","last_clean":"2024-04-14T10:58:05.572376+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:05.572376+0000","last_undegraded":"2024-04-14T10:58:05.572376+0000","last_fullsized":"2024-04-14T10:58:05.572376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571445+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:05.571445+0000","last_peered":"2024-04-14T10:58:05.571445+0000","last_clean":"2024-04-14T10:58:05.571445+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:05.571445+0000","last_undegraded":"2024-04-14T10:58:05.571445+0000","last_fullsized":"2024-04-14T10:58:05.571445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336984+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:05.336984+0000","last_peered":"2024-04-14T10:58:05.336984+0000","last_clean":"2024-04-14T10:58:05.336984+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:05.336984+0000","last_undegraded":"2024-04-14T10:58:05.336984+0000","last_fullsized":"2024-04-14T10:58:05.336984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":661302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:09.538 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T10:58:09.538 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-14T10:58:09.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-14T10:58:09.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-14T10:58:09.541 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-14T10:58:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.675+0000 7fdd47e6d640 1 Processor -- start 2024-04-14T10:58:09.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.675+0000 7fdd47e6d640 1 -- start start 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd47e6d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd40155090 0x7fdd40067720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd47e6d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd40071190 0x7fdd40067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd47e6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd4015b910 0x7fdd4006b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd47e6d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4015be50 con 0x7fdd40155090 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd47e6d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdd400c95c0 con 0x7fdd40071190 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd47e6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdd400c89b0 con 0x7fdd4015b910 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd45c09640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd40155090 0x7fdd40067720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd45c09640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fdd40155090 0x7fdd40067720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34596/0 (socket says 172.21.15.84:34596) 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.676+0000 7fdd45c09640 1 -- 172.21.15.84:0/3822320894 learned_addr learned my addr 172.21.15.84:0/3822320894 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:09.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45408640 1 --2- 172.21.15.84:0/3822320894 >> v2:172.21.15.175:3300/0 conn(0x7fdd40071190 0x7fdd40067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd4640a640 1 --2- 172.21.15.84:0/3822320894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd4015b910 0x7fdd4006b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45c09640 1 -- 172.21.15.84:0/3822320894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd4015b910 msgr2=0x7fdd4006b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45c09640 1 --2- 172.21.15.84:0/3822320894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd4015b910 0x7fdd4006b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45c09640 1 -- 172.21.15.84:0/3822320894 >> v2:172.21.15.175:3300/0 conn(0x7fdd40071190 msgr2=0x7fdd40067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45c09640 1 --2- 172.21.15.84:0/3822320894 >> v2:172.21.15.175:3300/0 conn(0x7fdd40071190 0x7fdd40067c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45c09640 1 -- 172.21.15.84:0/3822320894 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400c8c90 con 0x7fdd40155090 2024-04-14T10:58:09.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.677+0000 7fdd45c09640 1 --2- 172.21.15.84:0/3822320894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40155090 0x7fdd40067720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd40073cb0 tx=0x7fdd3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5ab1f6474953e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd44c07640 1 -- 172.21.15.84:0/3822320894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38035020 con 0x7fdd40155090 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd44c07640 1 -- 172.21.15.84:0/3822320894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd38031870 con 0x7fdd40155090 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd44c07640 1 -- 172.21.15.84:0/3822320894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38031c40 con 0x7fdd40155090 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 -- 172.21.15.84:0/3822320894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40155090 msgr2=0x7fdd40067720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/3822320894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40155090 0x7fdd40067720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd40073cb0 tx=0x7fdd3802b910 comp rx=0 tx=0).stop 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 -- 172.21.15.84:0/3822320894 shutdown_connections 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/3822320894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd4015b910 0x7fdd4006b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/3822320894 >> v2:172.21.15.175:3300/0 conn(0x7fdd40071190 0x7fdd40067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/3822320894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd40155090 0x7fdd40067720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 -- 172.21.15.84:0/3822320894 >> 172.21.15.84:0/3822320894 conn(0x7fdd400c9f70 msgr2=0x7fdd400ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 -- 172.21.15.84:0/3822320894 shutdown_connections 2024-04-14T10:58:09.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.678+0000 7fdd47e6d640 1 -- 172.21.15.84:0/3822320894 wait complete. 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.679+0000 7fdd47e6d640 1 Processor -- start 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.679+0000 7fdd47e6d640 1 -- start start 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd47e6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd40071190 0x7fdd401e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd47e6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd40155090 0x7fdd401510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd47e6d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 0x7fdd401e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd47e6d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdd40068240 con 0x7fdd4015b910 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd47e6d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400c9250 con 0x7fdd40155090 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd47e6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4006cd00 con 0x7fdd40071190 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 0x7fdd401e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 0x7fdd401e4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34604/0 (socket says 172.21.15.84:34604) 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 -- 172.21.15.84:0/713005175 learned_addr learned my addr 172.21.15.84:0/713005175 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd45c09640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd40071190 0x7fdd401e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd45408640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd40155090 0x7fdd401510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 -- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd40071190 msgr2=0x7fdd401e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd40071190 0x7fdd401e63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 -- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd40155090 msgr2=0x7fdd401510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd40155090 0x7fdd401510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 -- 172.21.15.84:0/713005175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd401f1a40 con 0x7fdd4015b910 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd45408640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd40155090 0x7fdd401510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd45c09640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd40071190 0x7fdd401e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:09.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.680+0000 7fdd4640a640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 0x7fdd401e4a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007e60 tx=0x7fdd3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.681+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c014420 con 0x7fdd4015b910 2024-04-14T10:58:09.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.681+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c019070 con 0x7fdd4015b910 2024-04-14T10:58:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.681+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd401e5e30 con 0x7fdd4015b910 2024-04-14T10:58:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.681+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c014820 con 0x7fdd4015b910 2024-04-14T10:58:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.681+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd401e4510 con 0x7fdd4015b910 2024-04-14T10:58:09.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.682+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd401e4710 con 0x7fdd4015b910 2024-04-14T10:58:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.682+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd3c0149c0 con 0x7fdd4015b910 2024-04-14T10:58:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.682+0000 7fdd367fc640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fdd2406c920 0x7fdd2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.683+0000 7fdd45c09640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fdd2406c920 0x7fdd2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.683+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdd3c08c340 con 0x7fdd4015b910 2024-04-14T10:58:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.683+0000 7fdd45c09640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fdd2406c920 0x7fdd2406ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdd38036000 tx=0x7fdd3803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:09.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.687+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fdd401e4710 con 0x7fdd4015b910 2024-04-14T10:58:09.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.909+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdd40069c30 con 0x7fdd4015b910 2024-04-14T10:58:09.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.912+0000 7fdd367fc640 1 -- 172.21.15.84:0/713005175 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174132 (secure 0 0 0) 0x7fdd3c05a770 con 0x7fdd4015b910 2024-04-14T10:58:09.913 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fdd2406c920 msgr2=0x7fdd2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fdd2406c920 0x7fdd2406ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdd38036000 tx=0x7fdd3803c040 comp rx=0 tx=0).stop 2024-04-14T10:58:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 msgr2=0x7fdd401e4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 0x7fdd401e4a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007e60 tx=0x7fdd3c00e4b0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 shutdown_connections 2024-04-14T10:58:09.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fdd2406c920 0x7fdd2406ede0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdd4015b910 0x7fdd401e4a30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd40155090 0x7fdd401510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 --2- 172.21.15.84:0/713005175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd40071190 0x7fdd401e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 >> 172.21.15.84:0/713005175 conn(0x7fdd400c9f70 msgr2=0x7fdd40153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 shutdown_connections 2024-04-14T10:58:09.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:09.914+0000 7fdd47e6d640 1 -- 172.21.15.84:0/713005175 wait complete. 2024-04-14T10:58:09.924 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":921762080},{"type":"v1","addr":"172.21.15.84:6833","nonce":921762080}]},"active_addr":"172.21.15.84:6833/921762080","active_change":"2024-04-14T10:57:43.392740+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":4167705016}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":664104985}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":469312413}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1654416201}]}]} 2024-04-14T10:58:09.927 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-14T10:58:09.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-14T10:58:09.927 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:10.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 Processor -- start 2024-04-14T10:58:10.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 -- start start 2024-04-14T10:58:10.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33a4154e90 0x7f33a406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33a40c8960 0x7f33a40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a40c92f0 con 0x7f33a406cf80 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f33a415bcc0 con 0x7f33a40c8960 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.029+0000 7f33aa71e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f33a415b140 con 0x7f33a4154e90 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a8cbb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33a40c8960 0x7f33a40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a37fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f33a406cf80 0x7f33a4067720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34250/0 (socket says 172.21.15.84:34250) 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a37fe640 1 -- 172.21.15.84:0/3325569461 learned_addr learned my addr 172.21.15.84:0/3325569461 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a3fff640 1 --2- 172.21.15.84:0/3325569461 >> v2:172.21.15.175:3300/0 conn(0x7f33a4154e90 0x7f33a406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a8cbb640 1 -- 172.21.15.84:0/3325569461 >> v2:172.21.15.175:3300/0 conn(0x7f33a4154e90 msgr2=0x7f33a406ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a8cbb640 1 --2- 172.21.15.84:0/3325569461 >> v2:172.21.15.175:3300/0 conn(0x7f33a4154e90 0x7f33a406ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a8cbb640 1 -- 172.21.15.84:0/3325569461 >> v1:172.21.15.84:6789/0 conn(0x7f33a406cf80 legacy=0x7f33a4067720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a2ffd640 1 -- 172.21.15.84:0/3325569461 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067424036 0 0) 0x7f33a40c92f0 con 0x7f33a406cf80 2024-04-14T10:58:10.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a8cbb640 1 -- 172.21.15.84:0/3325569461 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a415b420 con 0x7f33a40c8960 2024-04-14T10:58:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.030+0000 7f33a3fff640 1 --2- 172.21.15.84:0/3325569461 >> v2:172.21.15.175:3300/0 conn(0x7f33a4154e90 0x7f33a406ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33a8cbb640 1 --2- 172.21.15.84:0/3325569461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a40c8960 0x7f33a40c8db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f33a415be40 tx=0x7f339c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98090a1892fd25d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33a2ffd640 1 -- 172.21.15.84:0/3325569461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c039070 con 0x7f33a40c8960 2024-04-14T10:58:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33a2ffd640 1 -- 172.21.15.84:0/3325569461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339c02cbd0 con 0x7f33a40c8960 2024-04-14T10:58:10.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33a2ffd640 1 -- 172.21.15.84:0/3325569461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c034440 con 0x7f33a40c8960 2024-04-14T10:58:10.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 -- 172.21.15.84:0/3325569461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a40c8960 msgr2=0x7f33a40c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3325569461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a40c8960 0x7f33a40c8db0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f33a415be40 tx=0x7f339c02be20 comp rx=0 tx=0).stop 2024-04-14T10:58:10.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 -- 172.21.15.84:0/3325569461 shutdown_connections 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3325569461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a40c8960 0x7f33a40c8db0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3325569461 >> v2:172.21.15.175:3300/0 conn(0x7f33a4154e90 0x7f33a406ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 -- 172.21.15.84:0/3325569461 >> 172.21.15.84:0/3325569461 conn(0x7f33a40c9f70 msgr2=0x7f33a40ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 -- 172.21.15.84:0/3325569461 shutdown_connections 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.031+0000 7f33aa71e640 1 -- 172.21.15.84:0/3325569461 wait complete. 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.032+0000 7f33aa71e640 1 Processor -- start 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 -- start start 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 0x7f33a41581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a40c8960 0x7f33a41f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a4154e90 0x7f33a41f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33a40c8440 con 0x7f33a406cf80 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33a415b9e0 con 0x7f33a40c8960 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33aa71e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33a406ba50 con 0x7f33a4154e90 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 0x7f33a41581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 0x7f33a41581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34624/0 (socket says 172.21.15.84:34624) 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.033+0000 7f33a3fff640 1 -- 172.21.15.84:0/3804548027 learned_addr learned my addr 172.21.15.84:0/3804548027 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a8cbb640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a4154e90 0x7f33a41f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a37fe640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a40c8960 0x7f33a41f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a3fff640 1 -- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a4154e90 msgr2=0x7f33a41f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a3fff640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a4154e90 0x7f33a41f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a3fff640 1 -- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a40c8960 msgr2=0x7f33a41f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a3fff640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a40c8960 0x7f33a41f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a3fff640 1 -- 172.21.15.84:0/3804548027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a414fbd0 con 0x7f33a406cf80 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a8cbb640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a4154e90 0x7f33a41f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a3fff640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 0x7f33a41581b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f339800c820 tx=0x7f339800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398015070 con 0x7f33a406cf80 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3398007a30 con 0x7f33a406cf80 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398007de0 con 0x7f33a406cf80 2024-04-14T10:58:10.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a414feb0 con 0x7f33a406cf80 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.034+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a41f0710 con 0x7f33a406cf80 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.035+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a40c71a0 con 0x7f33a406cf80 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.035+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3398018070 con 0x7f33a406cf80 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.036+0000 7f33a0ff9640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f339006c920 0x7f339006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.036+0000 7f33a37fe640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f339006c920 0x7f339006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.036+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f339808b960 con 0x7f33a406cf80 2024-04-14T10:58:10.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.036+0000 7f33a37fe640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f339006c920 0x7f339006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3394007fd0 tx=0x7f3394009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.040+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f33a40c71a0 con 0x7f33a406cf80 2024-04-14T10:58:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.216+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33a40706a0 con 0x7f33a406cf80 2024-04-14T10:58:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.217+0000 7f33a0ff9640 1 -- 172.21.15.84:0/3804548027 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f3398059e20 con 0x7f33a406cf80 2024-04-14T10:58:10.217 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:10.217 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f339006c920 msgr2=0x7f339006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f339006c920 0x7f339006ede0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3394007fd0 tx=0x7f3394009040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 msgr2=0x7f33a41581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 0x7f33a41581b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f339800c820 tx=0x7f339800cce0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 shutdown_connections 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f339006c920 0x7f339006ede0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a4154e90 0x7f33a41f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a40c8960 0x7f33a41f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 --2- 172.21.15.84:0/3804548027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a406cf80 0x7f33a41581b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.219+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 >> 172.21.15.84:0/3804548027 conn(0x7f33a40c9f70 msgr2=0x7f33a406be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.220+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 shutdown_connections 2024-04-14T10:58:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.220+0000 7f33aa71e640 1 -- 172.21.15.84:0/3804548027 wait complete. 2024-04-14T10:58:10.230 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-14T10:58:10.230 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.331+0000 7f850cfbb640 1 Processor -- start 2024-04-14T10:58:10.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.331+0000 7f850cfbb640 1 -- start start 2024-04-14T10:58:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.331+0000 7f850cfbb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8508152f10 0x7f85081594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.331+0000 7f850cfbb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f850806f0d0 0x7f850815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850cfbb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85080c3ea0 con 0x7f850815cc30 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850cfbb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f85080c33b0 con 0x7f8508152f10 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850cfbb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f85080c3600 con 0x7f850806f0d0 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850659c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8508152f10 0x7f85081594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f8506d9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f850815cc30 0x7f85080ce300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34260/0 (socket says 172.21.15.84:34260) 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f8506d9d640 1 -- 172.21.15.84:0/2788339899 learned_addr learned my addr 172.21.15.84:0/2788339899 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850659c640 1 -- 172.21.15.84:0/2788339899 >> v2:172.21.15.175:3300/0 conn(0x7f850806f0d0 msgr2=0x7f850815c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f8505d9b640 1 --2- 172.21.15.84:0/2788339899 >> v2:172.21.15.175:3300/0 conn(0x7f850806f0d0 0x7f850815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850659c640 1 --2- 172.21.15.84:0/2788339899 >> v2:172.21.15.175:3300/0 conn(0x7f850806f0d0 0x7f850815c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850559a640 1 -- 172.21.15.84:0/2788339899 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299055957 0 0) 0x7f85080c3ea0 con 0x7f850815cc30 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850659c640 1 -- 172.21.15.84:0/2788339899 >> v1:172.21.15.84:6789/0 conn(0x7f850815cc30 legacy=0x7f85080ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.332+0000 7f850659c640 1 -- 172.21.15.84:0/2788339899 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85080c38e0 con 0x7f8508152f10 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850659c640 1 --2- 172.21.15.84:0/2788339899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8508152f10 0x7f85081594c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f850806ff60 tx=0x7f850002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13655cd579ce6bc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850559a640 1 -- 172.21.15.84:0/2788339899 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500035020 con 0x7f8508152f10 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850559a640 1 -- 172.21.15.84:0/2788339899 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8500031830 con 0x7f8508152f10 2024-04-14T10:58:10.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850559a640 1 -- 172.21.15.84:0/2788339899 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500031c00 con 0x7f8508152f10 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 -- 172.21.15.84:0/2788339899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8508152f10 msgr2=0x7f85081594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 --2- 172.21.15.84:0/2788339899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8508152f10 0x7f85081594c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f850806ff60 tx=0x7f850002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 -- 172.21.15.84:0/2788339899 shutdown_connections 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 --2- 172.21.15.84:0/2788339899 >> v2:172.21.15.175:3300/0 conn(0x7f850806f0d0 0x7f850815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 --2- 172.21.15.84:0/2788339899 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8508152f10 0x7f85081594c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 -- 172.21.15.84:0/2788339899 >> 172.21.15.84:0/2788339899 conn(0x7f850806db10 msgr2=0x7f850806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 -- 172.21.15.84:0/2788339899 shutdown_connections 2024-04-14T10:58:10.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.333+0000 7f850cfbb640 1 -- 172.21.15.84:0/2788339899 wait complete. 2024-04-14T10:58:10.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 Processor -- start 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 -- start start 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 0x7f85081568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8508152f10 0x7f8508154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f850815cc30 0x7f8508151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f85080700a0 con 0x7f850806f0d0 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f850815c1d0 con 0x7f8508152f10 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850cfbb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f850806fbd0 con 0x7f850815cc30 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 0x7f85081568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 0x7f85081568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34644/0 (socket says 172.21.15.84:34644) 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.335+0000 7f850659c640 1 -- 172.21.15.84:0/3090404161 learned_addr learned my addr 172.21.15.84:0/3090404161 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f8506d9d640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f850815cc30 0x7f8508151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f8505d9b640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8508152f10 0x7f8508154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850659c640 1 -- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f850815cc30 msgr2=0x7f8508151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850659c640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f850815cc30 0x7f8508151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850659c640 1 -- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8508152f10 msgr2=0x7f8508154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850659c640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8508152f10 0x7f8508154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850659c640 1 -- 172.21.15.84:0/3090404161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8508157220 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850659c640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 0x7f85081568b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8500009890 tx=0x7f85000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850003b9c0 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850003bb60 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85000453f0 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85081f16f0 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.336+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8508156f40 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.337+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8508069c30 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.337+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8500038020 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.338+0000 7f84f6ffd640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84e806c920 0x7f84e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.338+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85000ad8c0 con 0x7f850806f0d0 2024-04-14T10:58:10.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.338+0000 7f8505d9b640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84e806c920 0x7f84e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.338+0000 7f8505d9b640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84e806c920 0x7f84e806ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0070b0 tx=0x7f84fc007040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.342+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f8500040070 con 0x7f850806f0d0 2024-04-14T10:58:10.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.518+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f850815b260 con 0x7f850806f0d0 2024-04-14T10:58:10.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.519+0000 7f84f6ffd640 1 -- 172.21.15.84:0/3090404161 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f850007bd80 con 0x7f850806f0d0 2024-04-14T10:58:10.518 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:10.519 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84e806c920 msgr2=0x7f84e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84e806c920 0x7f84e806ede0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0070b0 tx=0x7f84fc007040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 msgr2=0x7f85081568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 0x7f85081568b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8500009890 tx=0x7f85000046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 shutdown_connections 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f84e806c920 0x7f84e806ede0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f850815cc30 0x7f8508151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8508152f10 0x7f8508154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 --2- 172.21.15.84:0/3090404161 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f850806f0d0 0x7f85081568b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 >> 172.21.15.84:0/3090404161 conn(0x7f850806db10 msgr2=0x7f85080c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 shutdown_connections 2024-04-14T10:58:10.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.521+0000 7f850cfbb640 1 -- 172.21.15.84:0/3090404161 wait complete. 2024-04-14T10:58:10.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-14T10:58:10.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-14T10:58:10.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-14T10:58:10.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-14T10:58:10.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-14T10:58:10.533 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-14T10:58:10.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-14T10:58:10.534 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-14T10:58:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.705+0000 7f33a7c80640 1 Processor -- start 2024-04-14T10:58:10.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.705+0000 7f33a7c80640 1 -- start start 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.705+0000 7f6ce7fff640 1 Processor -- start 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.705+0000 7f6ce7fff640 1 -- start start 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 0x7f6ce00dc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f6ce7fff640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce0007e80 con 0x7f6ce004c430 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f6ce7fff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ce0008160 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f6ce7fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce0007c30 con 0x7f6ce004d340 2024-04-14T10:58:10.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f33a7c80640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33a00b4c70 0x7f33a01632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f828738b640 1 Processor -- start 2024-04-14T10:58:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f6ce77fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 0x7f6ce00dc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f6ce77fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 0x7f6ce00dc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45062/0 (socket says 172.21.15.84:45062) 2024-04-14T10:58:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f6ce77fe640 1 -- 172.21.15.84:0/3007107293 learned_addr learned my addr 172.21.15.84:0/3007107293 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f89e12de640 1 Processor -- start 2024-04-14T10:58:10.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.706+0000 7f89e12de640 1 -- start start 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f33a7c80640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33a00b6380 0x7f33a00ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f33a7c80640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a00b3910 con 0x7f33a00b5050 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f33a7c80640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f33a0163800 con 0x7f33a00b6380 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f33a7c80640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f33a00b5ef0 con 0x7f33a00b4c70 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f33a5a1c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33a00b4c70 0x7f33a01632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33a00b6380 0x7f33a00ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f33a00b6380 0x7f33a00ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34652/0 (socket says 172.21.15.84:34652) 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 -- 172.21.15.84:0/2063158963 learned_addr learned my addr 172.21.15.84:0/2063158963 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89e12de640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f89dc071b80 0x7f89dc15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f6ce77fe640 1 -- 172.21.15.84:0/3007107293 >> v1:172.21.15.175:6789/0 conn(0x7f6ce00d2ba0 legacy=0x7f6ce004e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f6ce77fe640 1 -- 172.21.15.84:0/3007107293 >> v1:172.21.15.84:6789/0 conn(0x7f6ce004c430 legacy=0x7f6ce004cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f6ce77fe640 1 -- 172.21.15.84:0/3007107293 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce0008440 con 0x7f6ce004d340 2024-04-14T10:58:10.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89e12de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc15f530 0x7f89dc15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89e12de640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89dc072d80 con 0x7f89dc159250 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89e12de640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f89dc073060 con 0x7f89dc071b80 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89e12de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f89dc06ebd0 con 0x7f89dc15f530 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89daffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f89dc159250 0x7f89dc06f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34274/0 (socket says 172.21.15.84:34274) 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89daffd640 1 -- 172.21.15.84:0/3040796520 learned_addr learned my addr 172.21.15.84:0/3040796520 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f89da7fc640 1 --2- 172.21.15.84:0/3040796520 >> v2:172.21.15.175:3300/0 conn(0x7f89dc071b80 0x7f89dc15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f6ce77fe640 1 --2- 172.21.15.84:0/3007107293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 0x7f6ce00dc710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00bb40 tx=0x7f6cdc02e200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ad02af7464fe68 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.707+0000 7f828738b640 1 -- start start 2024-04-14T10:58:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f828738b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82780dc690 0x7f82780dcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f828738b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780db560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f6ce5ffb640 1 -- 172.21.15.84:0/3007107293 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc03b070 con 0x7f6ce004d340 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f828738b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8278007320 con 0x7f82780d53a0 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f828738b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8278007600 con 0x7f82780dc690 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f828738b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82780078e0 con 0x7f82780db140 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 -- 172.21.15.84:0/2063158963 >> v2:172.21.15.175:3300/0 conn(0x7f33a00b4c70 msgr2=0x7f33a01632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 --2- 172.21.15.84:0/2063158963 >> v2:172.21.15.175:3300/0 conn(0x7f33a00b4c70 0x7f33a01632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 -- 172.21.15.84:0/2063158963 >> v1:172.21.15.84:6789/0 conn(0x7f33a00b5050 legacy=0x7f33a00b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.708+0000 7f33a621d640 1 -- 172.21.15.84:0/2063158963 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00b3630 con 0x7f33a00b6380 2024-04-14T10:58:10.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f5b8158c640 1 Processor -- start 2024-04-14T10:58:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f6ce5ffb640 1 -- 172.21.15.84:0/3007107293 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc036440 con 0x7f6ce004d340 2024-04-14T10:58:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f6ce5ffb640 1 -- 172.21.15.84:0/3007107293 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0367f0 con 0x7f6ce004d340 2024-04-14T10:58:10.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285b88640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82780dc690 0x7f82780dcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285b88640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82780dc690 0x7f82780dcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34660/0 (socket says 172.21.15.84:34660) 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285b88640 1 -- 172.21.15.84:0/1136341764 learned_addr learned my addr 172.21.15.84:0/1136341764 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285387640 1 -- 172.21.15.84:0/1136341764 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377432592 0 0) 0x7f8278007320 con 0x7f82780d53a0 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f89db7fe640 1 --2- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc15f530 0x7f89dc15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f89da7fc640 1 -- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc15f530 msgr2=0x7f89dc15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f89da7fc640 1 --2- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc15f530 0x7f89dc15f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f89da7fc640 1 -- 172.21.15.84:0/3040796520 >> v1:172.21.15.84:6789/0 conn(0x7f89dc159250 legacy=0x7f89dc06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f89da7fc640 1 -- 172.21.15.84:0/3040796520 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc06eeb0 con 0x7f89dc071b80 2024-04-14T10:58:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285387640 1 -- 172.21.15.84:0/1136341764 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f826c003520 con 0x7f82780d53a0 2024-04-14T10:58:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8286b8a640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780db560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285b88640 1 -- 172.21.15.84:0/1136341764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 msgr2=0x7f82780db560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285b88640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780db560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f8285b88640 1 -- 172.21.15.84:0/1136341764 >> v1:172.21.15.84:6789/0 conn(0x7f82780d53a0 legacy=0x7f8278006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f4e1fbcc640 1 Processor -- start 2024-04-14T10:58:10.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f4e1fbcc640 1 -- start start 2024-04-14T10:58:10.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f8285b88640 1 -- 172.21.15.84:0/1136341764 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8278007bc0 con 0x7f82780dc690 2024-04-14T10:58:10.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f8286b8a640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780db560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:10.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f6ce7fff640 1 -- 172.21.15.84:0/3007107293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 msgr2=0x7f6ce00dc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f6ce7fff640 1 --2- 172.21.15.84:0/3007107293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 0x7f6ce00dc710 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc00bb40 tx=0x7f6cdc02e200 comp rx=0 tx=0).stop 2024-04-14T10:58:10.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f5b8158c640 1 -- start start 2024-04-14T10:58:10.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f33a621d640 1 --2- 172.21.15.84:0/2063158963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b6380 0x7f33a00ccfe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33a008e060 tx=0x7f339002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71623c348b360139 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f2b397fa640 1 Processor -- start 2024-04-14T10:58:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b8158c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f5b7c150ee0 0x7f5b7c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b8158c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b7c071730 0x7f5b7c0c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b8158c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b7c15b160 con 0x7f5b7c0c8f50 2024-04-14T10:58:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b8158c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5b7c073230 con 0x7f5b7c150ee0 2024-04-14T10:58:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b8158c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5b7c072130 con 0x7f5b7c071730 2024-04-14T10:58:10.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b7a7fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b7c071730 0x7f5b7c0c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.709+0000 7f2b397fa640 1 -- start start 2024-04-14T10:58:10.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f89da7fc640 1 --2- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc071b80 0x7f89dc15eff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097a0 tx=0x7f89cc02b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b17779feeff983f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f33a4a1a640 1 -- 172.21.15.84:0/2063158963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390034070 con 0x7f33a00b6380 2024-04-14T10:58:10.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f33a4a1a640 1 -- 172.21.15.84:0/2063158963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3390030860 con 0x7f33a00b6380 2024-04-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f2b397fa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b2c0d5230 0x7f2b2c0db240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f2b397fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c006ae0 0x7f2b2c04b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b397fa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b2c04bf20 0x7f2b2c0dc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b7a7fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b7c071730 0x7f5b7c0c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37414/0 (socket says 172.21.15.84:37414) 2024-04-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b7a7fc640 1 -- 172.21.15.84:0/1524529881 learned_addr learned my addr 172.21.15.84:0/1524529881 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.710+0000 7f5b7affd640 1 --2- 172.21.15.84:0/1524529881 >> v2:172.21.15.84:3300/0 conn(0x7f5b7c150ee0 0x7f5b7c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b397fa640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c008110 con 0x7f2b2c04bf20 2024-04-14T10:58:10.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b397fa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c007220 con 0x7f2b2c0d5230 2024-04-14T10:58:10.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b397fa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c007500 con 0x7f2b2c006ae0 2024-04-14T10:58:10.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f89d9ffb640 1 -- 172.21.15.84:0/3040796520 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc034070 con 0x7f89dc071b80 2024-04-14T10:58:10.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f6ce7fff640 1 -- 172.21.15.84:0/3007107293 shutdown_connections 2024-04-14T10:58:10.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f6ce7fff640 1 --2- 172.21.15.84:0/3007107293 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004d340 0x7f6ce00dc710 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f89d9ffb640 1 -- 172.21.15.84:0/3040796520 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc030800 con 0x7f89dc071b80 2024-04-14T10:58:10.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f89d9ffb640 1 -- 172.21.15.84:0/3040796520 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc030bd0 con 0x7f89dc071b80 2024-04-14T10:58:10.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f6ce7fff640 1 -- 172.21.15.84:0/3007107293 >> 172.21.15.84:0/3007107293 conn(0x7f6ce000d180 msgr2=0x7f6ce000d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f5b7a7fc640 1 -- 172.21.15.84:0/1524529881 >> v2:172.21.15.84:3300/0 conn(0x7f5b7c150ee0 msgr2=0x7f5b7c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f9ef1876640 1 Processor -- start 2024-04-14T10:58:10.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f33a4a1a640 1 -- 172.21.15.84:0/2063158963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3390030c30 con 0x7f33a00b6380 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1fbcc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18073820 0x7f4e180c8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1fbcc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4e18151090 0x7f4e18071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1fbcc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1806fa10 con 0x7f4e1806f440 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1fbcc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4e180c75c0 con 0x7f4e18151090 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1fbcc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4e180c78a0 con 0x7f4e18073820 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b32ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b2c0d5230 0x7f2b2c0db240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b337fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b2c04bf20 0x7f2b2c0dc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b32ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b2c0d5230 0x7f2b2c0db240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37420/0 (socket says 172.21.15.84:37420) 2024-04-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b32ffd640 1 -- 172.21.15.84:0/1375873581 learned_addr learned my addr 172.21.15.84:0/1375873581 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b337fe640 1 --2- 172.21.15.84:0/1375873581 >> v2:172.21.15.84:3300/0 conn(0x7f2b2c04bf20 0x7f2b2c0dc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34676/0 (socket says 172.21.15.84:34676) 2024-04-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f9ef1876640 1 -- start start 2024-04-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1d968640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18073820 0x7f4e180c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1e169640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4e1806f440 0x7f4e18156c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34306/0 (socket says 172.21.15.84:34306) 2024-04-14T10:58:10.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1e169640 1 -- 172.21.15.84:0/887369780 learned_addr learned my addr 172.21.15.84:0/887369780 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f4e1d167640 1 --2- 172.21.15.84:0/887369780 >> v2:172.21.15.84:3300/0 conn(0x7f4e18151090 0x7f4e18071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f8285b88640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780dcab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f827c00bb00 tx=0x7f827c02bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e995dbfcb4e78e39 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f8285387640 1 -- 172.21.15.84:0/1136341764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c032070 con 0x7f82780dc690 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f8285387640 1 -- 172.21.15.84:0/1136341764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f827c02cae0 con 0x7f82780dc690 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f33a7c80640 1 -- 172.21.15.84:0/2063158963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b6380 msgr2=0x7f33a00ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f33a7c80640 1 --2- 172.21.15.84:0/2063158963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b6380 0x7f33a00ccfe0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f33a008e060 tx=0x7f339002b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f33a7c80640 1 -- 172.21.15.84:0/2063158963 shutdown_connections 2024-04-14T10:58:10.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f33a7c80640 1 --2- 172.21.15.84:0/2063158963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b6380 0x7f33a00ccfe0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f33a7c80640 1 --2- 172.21.15.84:0/2063158963 >> v2:172.21.15.175:3300/0 conn(0x7f33a00b4c70 0x7f33a01632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f33a7c80640 1 -- 172.21.15.84:0/2063158963 >> 172.21.15.84:0/2063158963 conn(0x7f33a006b900 msgr2=0x7f33a006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f33a7c80640 1 -- 172.21.15.84:0/2063158963 shutdown_connections 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f33a7c80640 1 -- 172.21.15.84:0/2063158963 wait complete. 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f6ce7fff640 1 -- 172.21.15.84:0/3007107293 shutdown_connections 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b327fc640 1 --2- 172.21.15.84:0/1375873581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c006ae0 0x7f2b2c04b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b337fe640 1 -- 172.21.15.84:0/1375873581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c006ae0 msgr2=0x7f2b2c04b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f2b337fe640 1 --2- 172.21.15.84:0/1375873581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c006ae0 0x7f2b2c04b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f2b337fe640 1 -- 172.21.15.84:0/1375873581 >> v2:172.21.15.175:3300/0 conn(0x7f2b2c0d5230 msgr2=0x7f2b2c0db240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f2b337fe640 1 --2- 172.21.15.84:0/1375873581 >> v2:172.21.15.175:3300/0 conn(0x7f2b2c0d5230 0x7f2b2c0db240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f2b337fe640 1 -- 172.21.15.84:0/1375873581 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0077e0 con 0x7f2b2c04bf20 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f5b7a7fc640 1 --2- 172.21.15.84:0/1524529881 >> v2:172.21.15.84:3300/0 conn(0x7f5b7c150ee0 0x7f5b7c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f5b7a7fc640 1 -- 172.21.15.84:0/1524529881 >> v1:172.21.15.84:6789/0 conn(0x7f5b7c0c8f50 legacy=0x7f5b7c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.711+0000 7f5b7a7fc640 1 -- 172.21.15.84:0/1524529881 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c072410 con 0x7f5b7c071730 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f5b7affd640 1 --2- 172.21.15.84:0/1524529881 >> v2:172.21.15.84:3300/0 conn(0x7f5b7c150ee0 0x7f5b7c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:10.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9ef1876640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9eec1592f0 0x7f9eec0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9ef1876640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9eec072e50 0x7f9eec06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9ef1876640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 0x7f9eec0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9ef1876640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9eec15fad0 con 0x7f9eec072e50 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9ef1876640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9eec15fd70 con 0x7f9eec1592f0 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9ef1876640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec06ba80 con 0x7f9eec06c840 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 -- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc071b80 msgr2=0x7f89dc15eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 --2- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc071b80 0x7f89dc15eff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0097a0 tx=0x7f89cc02b940 comp rx=0 tx=0).stop 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 -- 172.21.15.84:0/3040796520 shutdown_connections 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 --2- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc15f530 0x7f89dc15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 --2- 172.21.15.84:0/3040796520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc071b80 0x7f89dc15eff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 -- 172.21.15.84:0/3040796520 >> 172.21.15.84:0/3040796520 conn(0x7f89dc0cc150 msgr2=0x7f89dc0cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f8285387640 1 -- 172.21.15.84:0/1136341764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c036400 con 0x7f82780dc690 2024-04-14T10:58:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f4e1d167640 1 -- 172.21.15.84:0/887369780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18073820 msgr2=0x7f4e180c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f4e1d167640 1 --2- 172.21.15.84:0/887369780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18073820 0x7f4e180c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f4e1d167640 1 -- 172.21.15.84:0/887369780 >> v1:172.21.15.84:6789/0 conn(0x7f4e1806f440 legacy=0x7f4e18156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f4e1d167640 1 -- 172.21.15.84:0/887369780 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e180c7b80 con 0x7f4e18151090 2024-04-14T10:58:10.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f6ce7fff640 1 -- 172.21.15.84:0/3007107293 wait complete. 2024-04-14T10:58:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f4e1d167640 1 --2- 172.21.15.84:0/887369780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e18151090 0x7f4e18071850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e080097a0 tx=0x7f4e0802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9790426aa1e45c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 -- 172.21.15.84:0/3040796520 shutdown_connections 2024-04-14T10:58:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f89e12de640 1 -- 172.21.15.84:0/3040796520 wait complete. 2024-04-14T10:58:10.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 -- 172.21.15.84:0/1136341764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 msgr2=0x7f82780dcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780dcab0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f827c00bb00 tx=0x7f827c02bd30 comp rx=0 tx=0).stop 2024-04-14T10:58:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f2b337fe640 1 --2- 172.21.15.84:0/1375873581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c04bf20 0x7f2b2c0dc730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c008d70 tx=0x7f2b2402fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e30d32336289362 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 -- 172.21.15.84:0/1136341764 shutdown_connections 2024-04-14T10:58:10.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780db560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f5b7a7fc640 1 --2- 172.21.15.84:0/1524529881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0c3cf0 tx=0x7f5b6402c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1158acb166a71a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f5b79ffb640 1 -- 172.21.15.84:0/1524529881 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64039070 con 0x7f5b7c071730 2024-04-14T10:58:10.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f5b79ffb640 1 -- 172.21.15.84:0/1524529881 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b64034640 con 0x7f5b7c071730 2024-04-14T10:58:10.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f5b79ffb640 1 -- 172.21.15.84:0/1524529881 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64034a10 con 0x7f5b7c071730 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 --2- 172.21.15.84:0/1136341764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780dcab0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 -- 172.21.15.84:0/1136341764 >> 172.21.15.84:0/1136341764 conn(0x7f8278050a00 msgr2=0x7f8278050e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 -- 172.21.15.84:0/1136341764 shutdown_connections 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f828738b640 1 -- 172.21.15.84:0/1136341764 wait complete. 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f2b31ffb640 1 -- 172.21.15.84:0/1375873581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b240307e0 con 0x7f2b2c04bf20 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f2b31ffb640 1 -- 172.21.15.84:0/1375873581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b24030980 con 0x7f2b2c04bf20 2024-04-14T10:58:10.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f2b31ffb640 1 -- 172.21.15.84:0/1375873581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24030d50 con 0x7f2b2c04bf20 2024-04-14T10:58:10.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f4e1c966640 1 -- 172.21.15.84:0/887369780 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08031780 con 0x7f4e18151090 2024-04-14T10:58:10.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f4e1c966640 1 -- 172.21.15.84:0/887369780 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e08037070 con 0x7f4e18151090 2024-04-14T10:58:10.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f5b8158c640 1 -- 172.21.15.84:0/1524529881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 msgr2=0x7f5b7c0c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f6ce7fff640 1 Processor -- start 2024-04-14T10:58:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f5b8158c640 1 --2- 172.21.15.84:0/1524529881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c8a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0c3cf0 tx=0x7f5b6402c2d0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f89e12de640 1 Processor -- start 2024-04-14T10:58:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f33a7c80640 1 Processor -- start 2024-04-14T10:58:10.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f33a7c80640 1 -- start start 2024-04-14T10:58:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f4e1c966640 1 -- 172.21.15.84:0/887369780 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08031b40 con 0x7f4e18151090 2024-04-14T10:58:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/887369780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e18151090 msgr2=0x7f4e18071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f4e1fbcc640 1 --2- 172.21.15.84:0/887369780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e18151090 0x7f4e18071850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e080097a0 tx=0x7f4e0802b820 comp rx=0 tx=0).stop 2024-04-14T10:58:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f89e12de640 1 -- start start 2024-04-14T10:58:10.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f6ce7fff640 1 -- start start 2024-04-14T10:58:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 -- 172.21.15.84:0/1375873581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c04bf20 msgr2=0x7f2b2c0dc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f5b8158c640 1 -- 172.21.15.84:0/1524529881 shutdown_connections 2024-04-14T10:58:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f5b8158c640 1 --2- 172.21.15.84:0/1524529881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c8a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f5b8158c640 1 --2- 172.21.15.84:0/1524529881 >> v2:172.21.15.84:3300/0 conn(0x7f5b7c150ee0 0x7f5b7c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f5b8158c640 1 -- 172.21.15.84:0/1524529881 >> 172.21.15.84:0/1524529881 conn(0x7f5b7c06bd20 msgr2=0x7f5b7c06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 --2- 172.21.15.84:0/1375873581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c04bf20 0x7f2b2c0dc730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c008d70 tx=0x7f2b2402fc40 comp rx=0 tx=0).stop 2024-04-14T10:58:10.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 0x7f9eec0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/887369780 shutdown_connections 2024-04-14T10:58:10.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f4e1fbcc640 1 --2- 172.21.15.84:0/887369780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e18151090 0x7f4e18071850 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f4e1fbcc640 1 --2- 172.21.15.84:0/887369780 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18073820 0x7f4e180c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/887369780 >> 172.21.15.84:0/887369780 conn(0x7f4e180cc150 msgr2=0x7f4e180cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.712+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 0x7f9eec0c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45112/0 (socket says 172.21.15.84:45112) 2024-04-14T10:58:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eebfff640 1 -- 172.21.15.84:0/509201840 learned_addr learned my addr 172.21.15.84:0/509201840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eea7fc640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.84:3300/0 conn(0x7f9eec072e50 0x7f9eec06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f828738b640 1 Processor -- start 2024-04-14T10:58:10.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f828738b640 1 -- start start 2024-04-14T10:58:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 -- 172.21.15.84:0/1375873581 shutdown_connections 2024-04-14T10:58:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 --2- 172.21.15.84:0/1375873581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c04bf20 0x7f2b2c0dc730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 --2- 172.21.15.84:0/1375873581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c006ae0 0x7f2b2c04b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 --2- 172.21.15.84:0/1375873581 >> v2:172.21.15.175:3300/0 conn(0x7f2b2c0d5230 0x7f2b2c0db240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f2b397fa640 1 -- 172.21.15.84:0/1375873581 >> 172.21.15.84:0/1375873581 conn(0x7f2b2c04d4e0 msgr2=0x7f2b2c04d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eeaffd640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.175:3300/0 conn(0x7f9eec1592f0 0x7f9eec0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eebfff640 1 -- 172.21.15.84:0/509201840 >> v2:172.21.15.175:3300/0 conn(0x7f9eec1592f0 msgr2=0x7f9eec0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f5b8158c640 1 -- 172.21.15.84:0/1524529881 shutdown_connections 2024-04-14T10:58:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f5b8158c640 1 -- 172.21.15.84:0/1524529881 wait complete. 2024-04-14T10:58:10.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eebfff640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.175:3300/0 conn(0x7f9eec1592f0 0x7f9eec0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eebfff640 1 -- 172.21.15.84:0/509201840 >> v2:172.21.15.84:3300/0 conn(0x7f9eec072e50 msgr2=0x7f9eec06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eebfff640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.84:3300/0 conn(0x7f9eec072e50 0x7f9eec06e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.713+0000 7f9eebfff640 1 -- 172.21.15.84:0/509201840 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec06bd60 con 0x7f9eec06c840 2024-04-14T10:58:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.714+0000 7f9eeaffd640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.175:3300/0 conn(0x7f9eec1592f0 0x7f9eec0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f9eea7fc640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.84:3300/0 conn(0x7f9eec072e50 0x7f9eec06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:10.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f9eebfff640 1 --2- 172.21.15.84:0/509201840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 0x7f9eec0c8bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0cb3f0 tx=0x7f9ee402bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03b6ff8bb7d38e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f33a7c80640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a00b4c70 0x7f33a01f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f89e12de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc071b80 0x7f89dc0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f89e12de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc159250 0x7f89dc0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f89e12de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc15f530 0x7f89dc1f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f33a7c80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b5050 0x7f33a01f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f89e12de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc15fee0 con 0x7f89dc159250 2024-04-14T10:58:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f89e12de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc071fd0 con 0x7f89dc15f530 2024-04-14T10:58:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f89e12de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f89dc0c8800 con 0x7f89dc071b80 2024-04-14T10:58:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f9ee9ffb640 1 -- 172.21.15.84:0/509201840 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee402cb40 con 0x7f9eec06c840 2024-04-14T10:58:10.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f9ee9ffb640 1 -- 172.21.15.84:0/509201840 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee402cce0 con 0x7f9eec06c840 2024-04-14T10:58:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89da7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc159250 0x7f89dc0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004c430 0x7f6ce00d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89da7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc159250 0x7f89dc0cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34710/0 (socket says 172.21.15.84:34710) 2024-04-14T10:58:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89da7fc640 1 -- 172.21.15.84:0/4203312338 learned_addr learned my addr 172.21.15.84:0/4203312338 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89db7fe640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc15f530 0x7f89dc1f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f9ee9ffb640 1 -- 172.21.15.84:0/509201840 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4034610 con 0x7f9eec06c840 2024-04-14T10:58:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ce004d340 0x7f6ce00cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89daffd640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc071b80 0x7f89dc0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce00d2ba0 0x7f6ce00cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f33a5a1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a00b4c70 0x7f33a01f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce7fff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce004e7a0 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.715+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/887369780 shutdown_connections 2024-04-14T10:58:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce7fff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce0008a90 con 0x7f6ce004d340 2024-04-14T10:58:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce7fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6ce004e920 con 0x7f6ce004c430 2024-04-14T10:58:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f828738b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82780d53a0 0x7f8278035300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89db7fe640 1 -- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc071b80 msgr2=0x7f89dc0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89db7fe640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89dc071b80 0x7f89dc0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89db7fe640 1 -- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc159250 msgr2=0x7f89dc0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f828738b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f828738b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f828738b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82780dcff0 con 0x7f82780dc690 2024-04-14T10:58:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f828738b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8278008180 con 0x7f82780d53a0 2024-04-14T10:58:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f828738b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f827804d1f0 con 0x7f82780db140 2024-04-14T10:58:10.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce67fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ce004d340 0x7f6ce00cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f2b397fa640 1 -- 172.21.15.84:0/1375873581 shutdown_connections 2024-04-14T10:58:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f8285b88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f2b397fa640 1 -- 172.21.15.84:0/1375873581 wait complete. 2024-04-14T10:58:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f8286b8a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f8285b88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45136/0 (socket says 172.21.15.84:45136) 2024-04-14T10:58:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f8285b88640 1 -- 172.21.15.84:0/2503424221 learned_addr learned my addr 172.21.15.84:0/2503424221 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89db7fe640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc159250 0x7f89dc0cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f33a5a1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a00b4c70 0x7f33a01f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37450/0 (socket says 172.21.15.84:37450) 2024-04-14T10:58:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f33a5a1c640 1 -- 172.21.15.84:0/904374989 learned_addr learned my addr 172.21.15.84:0/904374989 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f33a521b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b5050 0x7f33a01f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce67fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ce004d340 0x7f6ce00cfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37466/0 (socket says 172.21.15.84:37466) 2024-04-14T10:58:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce67fc640 1 -- 172.21.15.84:0/1959823714 learned_addr learned my addr 172.21.15.84:0/1959823714 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce77fe640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce00d2ba0 0x7f6ce00cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f6ce6ffd640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004c430 0x7f6ce00d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a7c80640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a00b6380 0x7f33a00c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f89db7fe640 1 -- 172.21.15.84:0/4203312338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc0c83b0 con 0x7f89dc15f530 2024-04-14T10:58:10.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.716+0000 7f8286389640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82780d53a0 0x7f8278035300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00b5b80 con 0x7f33a00b5050 2024-04-14T10:58:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33a00b58a0 con 0x7f33a00b4c70 2024-04-14T10:58:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33a00b31f0 con 0x7f33a00b6380 2024-04-14T10:58:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 -- 172.21.15.84:0/509201840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 msgr2=0x7f9eec0c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 --2- 172.21.15.84:0/509201840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 0x7f9eec0c8bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0cb3f0 tx=0x7f9ee402bfa0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ce77fe640 1 -- 172.21.15.84:0/1959823714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004c430 msgr2=0x7f6ce00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ce77fe640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ce004c430 0x7f6ce00d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ce77fe640 1 -- 172.21.15.84:0/1959823714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ce004d340 msgr2=0x7f6ce00cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ce77fe640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ce004d340 0x7f6ce00cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ce77fe640 1 -- 172.21.15.84:0/1959823714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce00cf440 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8286b8a640 1 -- 172.21.15.84:0/2503424221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 msgr2=0x7f82780c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 -- 172.21.15.84:0/509201840 shutdown_connections 2024-04-14T10:58:10.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 --2- 172.21.15.84:0/509201840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec06c840 0x7f9eec0c8bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.84:3300/0 conn(0x7f9eec072e50 0x7f9eec06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 --2- 172.21.15.84:0/509201840 >> v2:172.21.15.175:3300/0 conn(0x7f9eec1592f0 0x7f9eec0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f9ef1876640 1 -- 172.21.15.84:0/509201840 >> 172.21.15.84:0/509201840 conn(0x7f9eec0ca330 msgr2=0x7f9eec0ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8286b8a640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82780db140 0x7f82780c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8286b8a640 1 -- 172.21.15.84:0/2503424221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82780d53a0 msgr2=0x7f8278035300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8286b8a640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82780d53a0 0x7f8278035300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f89da7fc640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89dc159250 0x7f89dc0cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8286b8a640 1 -- 172.21.15.84:0/2503424221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8278036860 con 0x7f82780dc690 2024-04-14T10:58:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ce77fe640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce00d2ba0 0x7f6ce00cd110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc035000 tx=0x7f6cdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f89db7fe640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc15f530 0x7f89dc1f7f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89d000c5c0 tx=0x7f89d000ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8286b8a640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780de4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8280050b00 tx=0x7f828006cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a621d640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a00b6380 0x7f33a00c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a521b640 1 -- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a00b6380 msgr2=0x7f33a00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a521b640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33a00b6380 0x7f33a00c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a521b640 1 -- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a00b4c70 msgr2=0x7f33a01f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a521b640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a00b4c70 0x7f33a01f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a521b640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a00c9110 con 0x7f33a00b5050 2024-04-14T10:58:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0015070 con 0x7f89dc15f530 2024-04-14T10:58:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280099070 con 0x7f82780dc690 2024-04-14T10:58:10.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82800716f0 con 0x7f82780dc690 2024-04-14T10:58:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280071aa0 con 0x7f82780dc690 2024-04-14T10:58:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f828738b640 1 -- 172.21.15.84:0/2503424221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8278036b40 con 0x7f82780dc690 2024-04-14T10:58:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc03b030 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cdc03d070 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc0367f0 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f828738b640 1 -- 172.21.15.84:0/2503424221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82780d4790 con 0x7f82780dc690 2024-04-14T10:58:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f89e12de640 1 -- 172.21.15.84:0/4203312338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc156e80 con 0x7f89dc15f530 2024-04-14T10:58:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f89e12de640 1 -- 172.21.15.84:0/4203312338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89dc0c7670 con 0x7f89dc15f530 2024-04-14T10:58:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f6ce7fff640 1 -- 172.21.15.84:0/1959823714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce00cc570 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f33a5a1c640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33a00b4c70 0x7f33a01f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:10.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f33a521b640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b5050 0x7f33a01f6a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f339800c7b0 tx=0x7f339800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f5b8158c640 1 Processor -- start 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.717+0000 7f5b8158c640 1 -- start start 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b8158c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b8158c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0c8f50 0x7f5b7c2007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b8158c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7c150ee0 0x7f5b7c146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b8158c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c072f50 con 0x7f5b7c150ee0 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b8158c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7c0c9380 con 0x7f5b7c071730 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b8158c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7c1512c0 con 0x7f5b7c0c8f50 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37484/0 (socket says 172.21.15.84:37484) 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b7affd640 1 -- 172.21.15.84:0/227829711 learned_addr learned my addr 172.21.15.84:0/227829711 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b7b7fe640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7c150ee0 0x7f5b7c146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f5b7a7fc640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0c8f50 0x7f5b7c2007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f9ef1876640 1 -- 172.21.15.84:0/509201840 shutdown_connections 2024-04-14T10:58:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d0004220 con 0x7f89dc15f530 2024-04-14T10:58:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0003610 con 0x7f89dc15f530 2024-04-14T10:58:10.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7affd640 1 -- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0c8f50 msgr2=0x7f5b7c2007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7affd640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b7c0c8f50 0x7f5b7c2007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7affd640 1 -- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7c150ee0 msgr2=0x7f5b7c146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7affd640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7c150ee0 0x7f5b7c146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7affd640 1 -- 172.21.15.84:0/227829711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7c201220 con 0x7f5b7c071730 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7b7fe640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b7c150ee0 0x7f5b7c146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f828738b640 1 -- 172.21.15.84:0/2503424221 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82780057d0 con 0x7f82780dc690 2024-04-14T10:58:10.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3398016020 con 0x7f33a00b5050 2024-04-14T10:58:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f5b7affd640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c4640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400ebe0 tx=0x7f5b7400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f2b397fa640 1 Processor -- start 2024-04-14T10:58:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f339800aa90 con 0x7f33a00b5050 2024-04-14T10:58:10.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f6ce7fff640 1 -- 172.21.15.84:0/1959823714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce00cbfb0 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.718+0000 7f9ef1876640 1 -- 172.21.15.84:0/509201840 wait complete. 2024-04-14T10:58:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74017070 con 0x7f5b7c071730 2024-04-14T10:58:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7400cc30 con 0x7f5b7c071730 2024-04-14T10:58:10.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74013470 con 0x7f5b7c071730 2024-04-14T10:58:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f89e12de640 1 -- 172.21.15.84:0/4203312338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89bc001030 con 0x7f89dc15f530 2024-04-14T10:58:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.719+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/887369780 wait complete. 2024-04-14T10:58:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339800ce60 con 0x7f33a00b5050 2024-04-14T10:58:10.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f6ce7fff640 1 -- 172.21.15.84:0/1959823714 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ce00cbda0 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f2b397fa640 1 -- start start 2024-04-14T10:58:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7c1e9770 con 0x7f5b7c071730 2024-04-14T10:58:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89d00037b0 con 0x7f89dc15f530 2024-04-14T10:58:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f9ef1876640 1 Processor -- start 2024-04-14T10:58:10.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f9ef1876640 1 -- start start 2024-04-14T10:58:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89c37fe640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f89c806c9f0 0x7f89c806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f4e1fbcc640 1 Processor -- start 2024-04-14T10:58:10.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f89d008b7e0 con 0x7f89dc15f530 2024-04-14T10:58:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f2b397fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b2c006ae0 0x7f2b2c163070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89daffd640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f89c806c9f0 0x7f89c806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89c37fe640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] conn(0x7f89c8074c70 0x7f89c8077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f2b397fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c04bf20 0x7f2b2c0da700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 --> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89d0007e50 con 0x7f89c8074c70 2024-04-14T10:58:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6cdc048060 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f2b397fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c0d5230 0x7f2b2c172ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f89d0092050 con 0x7f89dc15f530 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a00c93b0 con 0x7f33a00b5050 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a00c9670 con 0x7f33a00b5050 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f2b32ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b2c006ae0 0x7f2b2c163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b2c006ae0 0x7f2b2c163070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37488/0 (socket says 172.21.15.84:37488) 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b337fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c0d5230 0x7f2b2c172ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 -- 172.21.15.84:0/2489965635 learned_addr learned my addr 172.21.15.84:0/2489965635 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c006f20 con 0x7f2b2c0d5230 2024-04-14T10:58:10.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c007da0 con 0x7f2b2c006ae0 2024-04-14T10:58:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0d5610 con 0x7f2b2c04bf20 2024-04-14T10:58:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9ef1876640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eec06c840 0x7f9eec1efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f89da7fc640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] conn(0x7f89c8074c70 0x7f89c8077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9ef1876640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9eec072e50 0x7f9eec15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f828009c070 con 0x7f82780dc690 2024-04-14T10:58:10.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b327fc640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c04bf20 0x7f2b2c0da700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9ef1876640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec1592f0 0x7f9eec1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.721+0000 7f4e1fbcc640 1 -- start start 2024-04-14T10:58:10.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f6ccffff640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f6cd406c9c0 0x7f6cd406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9ef1876640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec0c90f0 con 0x7f9eec072e50 2024-04-14T10:58:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9ef1876640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec1596d0 con 0x7f9eec06c840 2024-04-14T10:58:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9ef1876640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec0c9270 con 0x7f9eec1592f0 2024-04-14T10:58:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6cdc0adb20 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f6ce6ffd640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f6cd406c9c0 0x7f6cd406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f6ccffff640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] conn(0x7f6cd4074be0 0x7f6cd4077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 --> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cdc00d140 con 0x7f6cd4074be0 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 -- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c04bf20 msgr2=0x7f2b2c0da700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b2c04bf20 0x7f2b2c0da700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 -- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c0d5230 msgr2=0x7f2b2c172ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b2c0d5230 0x7f2b2c172ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0da4b0 con 0x7f2b2c006ae0 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6cdc0adf10 con 0x7f6ce00d2ba0 2024-04-14T10:58:10.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f8272ffd640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f826406c970 0x7f826406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f89da7fc640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] conn(0x7f89c8074c70 0x7f89c8077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f2b32ffd640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b2c006ae0 0x7f2b2c163070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800dad0 tx=0x7f2b2800df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec1592f0 0x7f9eec1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9eea7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9eec072e50 0x7f9eec15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9eea7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9eec072e50 0x7f9eec15a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34746/0 (socket says 172.21.15.84:34746) 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f9eea7fc640 1 -- 172.21.15.84:0/2236440860 learned_addr learned my addr 172.21.15.84:0/2236440860 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eeaffd640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eec06c840 0x7f9eec1efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.722+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8280107f50 con 0x7f82780dc690 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f8272ffd640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] conn(0x7f8264074bf0 0x7f8264077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 --> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82640776c0 con 0x7f8264074bf0 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f8280108430 con 0x7f82780dc690 2024-04-14T10:58:10.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f8286389640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f826406c970 0x7f826406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.720+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7c1e9d30 con 0x7f5b7c071730 2024-04-14T10:58:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b28015420 con 0x7f2b2c006ae0 2024-04-14T10:58:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c0d9ef0 con 0x7f2b2c006ae0 2024-04-14T10:58:10.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f8285b88640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] conn(0x7f8264074bf0 0x7f8264077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c162590 con 0x7f2b2c006ae0 2024-04-14T10:58:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b2801a070 con 0x7f2b2c006ae0 2024-04-14T10:58:10.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f6ce67fc640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] conn(0x7f6cd4074be0 0x7f6cd4077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f4e1fbcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1806f440 0x7f4e18156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f4e1fbcc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e18073820 0x7f4e180c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f4e1fbcc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18151090 0x7f4e18149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f4e1fbcc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e180721a0 con 0x7f4e1806f440 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f4e1fbcc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e18072020 con 0x7f4e18073820 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f4e1fbcc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4e18157390 con 0x7f4e18151090 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d968640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1806f440 0x7f4e18156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d968640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1806f440 0x7f4e18156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34754/0 (socket says 172.21.15.84:34754) 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d968640 1 -- 172.21.15.84:0/4224062820 learned_addr learned my addr 172.21.15.84:0/4224062820 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:10.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f8286389640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f826406c970 0x7f826406ee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82740011e0 tx=0x7f8274009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e18073820 0x7f4e180c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1e169640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18151090 0x7f4e18149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 -- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18151090 msgr2=0x7f4e18149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e18151090 0x7f4e18149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 -- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1806f440 msgr2=0x7f4e18156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e1806f440 0x7f4e18156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 -- 172.21.15.84:0/4224062820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e18149050 con 0x7f4e18073820 2024-04-14T10:58:10.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f4e1d167640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e18073820 0x7f4e180c4bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e18068660 tx=0x7f4e080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f3383fff640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33a00cf3c0 con 0x7f33a00b5050 2024-04-14T10:58:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f6ce6ffd640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f6cd406c9c0 0x7f6cd406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8000f60 tx=0x7f6cd8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f6ce67fc640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] conn(0x7f6cd4074be0 0x7f6cd4077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b280157c0 con 0x7f2b2c006ae0 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eea7fc640 1 -- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec1592f0 msgr2=0x7f9eec1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eea7fc640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9eec1592f0 0x7f9eec1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eea7fc640 1 -- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eec06c840 msgr2=0x7f9eec1efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eea7fc640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eec06c840 0x7f9eec1efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eea7fc640 1 -- 172.21.15.84:0/2236440860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec0c6640 con 0x7f9eec072e50 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.723+0000 7f9eea7fc640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9eec072e50 0x7f9eec15a7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000e810 tx=0x7f9ee000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000f040 con 0x7f9eec072e50 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee0004030 con 0x7f9eec072e50 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0004400 con 0x7f9eec072e50 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec0c6920 con 0x7f9eec072e50 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec0c6ee0 con 0x7f9eec072e50 2024-04-14T10:58:10.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.724+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== osd.7 v2:172.21.15.175:6800/640638539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89d0007e50 con 0x7f89c8074c70 2024-04-14T10:58:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b7c0699a0 con 0x7f5b7c071730 2024-04-14T10:58:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08032820 con 0x7f4e18073820 2024-04-14T10:58:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/4224062820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1813a1c0 con 0x7f4e18073820 2024-04-14T10:58:10.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/4224062820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1813a780 con 0x7f4e18073820 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e08032a00 con 0x7f4e18073820 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08032df0 con 0x7f4e18073820 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3398019020 con 0x7f33a00b5050 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f33967fc640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f338406c9f0 0x7f338406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f339808b6d0 con 0x7f33a00b5050 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f33967fc640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] conn(0x7f3384074b90 0x7f3384076fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f339800aa90 con 0x7f3384074b90 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f33a5a1c640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f338406c9f0 0x7f338406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b7401a070 con 0x7f5b7c071730 2024-04-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f5b737fe640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5b5c06c9f0 0x7f5b5c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5b7408bd20 con 0x7f5b7c071730 2024-04-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f5b737fe640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] conn(0x7f5b5c074b90 0x7f5b5c076fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 --> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b7401fe50 con 0x7f5b5c074b90 2024-04-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f89daffd640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f89c806c9f0 0x7f89c806eeb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89d4005c00 tx=0x7f89d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f8285b88640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] conn(0x7f8264074bf0 0x7f8264077010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f33a621d640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] conn(0x7f3384074b90 0x7f3384076fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.725+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b14001030 con 0x7f2b2c006ae0 2024-04-14T10:58:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b28005990 con 0x7f2b2c006ae0 2024-04-14T10:58:10.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== osd.3 v2:172.21.15.84:6800/895171386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cdc00d140 con 0x7f6cd4074be0 2024-04-14T10:58:10.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.726+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9eec068370 con 0x7f9eec072e50 2024-04-14T10:58:10.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== osd.0 v2:172.21.15.84:6804/4267696951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f82640776c0 con 0x7f8264074bf0 2024-04-14T10:58:10.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f2b1b7fe640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2b2006c940 0x7f2b2006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f33a621d640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] conn(0x7f3384074b90 0x7f3384076fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e0804d3f0 con 0x7f4e18073820 2024-04-14T10:58:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5b74055e10 con 0x7f5b7c071730 2024-04-14T10:58:10.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/4224062820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e00001030 con 0x7f4e18073820 2024-04-14T10:58:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f2b327fc640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2b2006c940 0x7f2b2006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f4e0e7fc640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4dfc06c9c0 0x7f4dfc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f2b327fc640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2b2006c940 0x7f2b2006ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b3402db70 tx=0x7f2b3406e040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.727+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e080ad440 con 0x7f4e18073820 2024-04-14T10:58:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f4e0e7fc640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] conn(0x7f4dfc074bc0 0x7f4dfc076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 --> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4dfc077690 con 0x7f4dfc074bc0 2024-04-14T10:58:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f4e1d968640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4dfc06c9c0 0x7f4dfc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b2808be60 con 0x7f2b2c006ae0 2024-04-14T10:58:10.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== osd.2 v2:172.21.15.84:6824/3317034191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f339800aa90 con 0x7f3384074b90 2024-04-14T10:58:10.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4e080b4050 con 0x7f4e18073820 2024-04-14T10:58:10.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f2b1b7fe640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] conn(0x7f2b20074b40 0x7f2b20076f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b2801a070 con 0x7f2b20074b40 2024-04-14T10:58:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f5b7a7fc640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5b5c06c9f0 0x7f5b5c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f4e1d968640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4dfc06c9c0 0x7f4dfc06ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009c00 tx=0x7f4e14009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f2b2808c210 con 0x7f2b2c006ae0 2024-04-14T10:58:10.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f5b7b7fe640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] conn(0x7f5b5c074b90 0x7f5b5c076fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3398055710 con 0x7f33a00b5050 2024-04-14T10:58:10.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ee000c6d0 con 0x7f9eec072e50 2024-04-14T10:58:10.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f4e1e169640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] conn(0x7f4dfc074bc0 0x7f4dfc076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f9ed3fff640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9ed806c940 0x7f9ed806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9ee008b690 con 0x7f9eec072e50 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.728+0000 7f9ed3fff640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] conn(0x7f9ed8074b60 0x7f9ed8076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 --> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ed8077630 con 0x7f9ed8074b60 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9ee0092050 con 0x7f9eec072e50 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f5b7a7fc640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5b5c06c9f0 0x7f5b5c06eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b64036000 tx=0x7f5b64030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f9eeaffd640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9ed806c940 0x7f9ed806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f5b7b7fe640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] conn(0x7f5b5c074b90 0x7f5b5c076fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f33a5a1c640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f338406c9f0 0x7f338406eeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f339c006fd0 tx=0x7f339c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f9eebfff640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] conn(0x7f9ed8074b60 0x7f9ed8076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f4e1e169640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] conn(0x7f4dfc074bc0 0x7f4dfc076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f2b337fe640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] conn(0x7f2b20074b40 0x7f2b20076f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.729+0000 7f2b337fe640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] conn(0x7f2b20074b40 0x7f2b20076f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.730+0000 7f9eeaffd640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9ed806c940 0x7f9ed806ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0099c0 tx=0x7f9edc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.730+0000 7f9eebfff640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] conn(0x7f9ed8074b60 0x7f9ed8076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.730+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== osd.5 v2:172.21.15.175:6824/1825582812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b7401fe50 con 0x7f5b5c074b90 2024-04-14T10:58:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.730+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== osd.1 v2:172.21.15.84:6816/2733326547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4dfc077690 con 0x7f4dfc074bc0 2024-04-14T10:58:10.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.730+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== osd.4 v2:172.21.15.175:6816/324857761 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b2801a070 con 0x7f2b20074b40 2024-04-14T10:58:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.734+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== osd.6 v2:172.21.15.175:6801/1284380825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ed8077630 con 0x7f9ed8074b60 2024-04-14T10:58:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.752+0000 7f89e12de640 1 -- 172.21.15.84:0/4203312338 --> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f89bc002dd0 con 0x7f89c8074c70 2024-04-14T10:58:10.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.753+0000 7f89c37fe640 1 -- 172.21.15.84:0/4203312338 <== osd.7 v2:172.21.15.175:6800/640638539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f89bc002dd0 con 0x7f89c8074c70 2024-04-14T10:58:10.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.754+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] conn(0x7f89c8074c70 msgr2=0x7f89c8077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.754+0000 7f89c17fa640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:6800/640638539,v1:172.21.15.175:6802/640638539] conn(0x7f89c8074c70 0x7f89c8077090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.754+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f89c806c9f0 msgr2=0x7f89c806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.754+0000 7f89c17fa640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f89c806c9f0 0x7f89c806eeb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89d4005c00 tx=0x7f89d4009040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.754+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc15f530 msgr2=0x7f89dc1f7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.754+0000 7f89c17fa640 1 --2- 172.21.15.84:0/4203312338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89dc15f530 0x7f89dc1f7f50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f89d000c5c0 tx=0x7f89d000ca80 comp rx=0 tx=0).stop 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.755+0000 7f89db7fe640 1 -- 172.21.15.84:0/4203312338 reap_dead start 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.755+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 shutdown_connections 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.755+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 >> 172.21.15.84:0/4203312338 conn(0x7f89dc0cc150 msgr2=0x7f89dc0c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.755+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 shutdown_connections 2024-04-14T10:58:10.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.755+0000 7f89c17fa640 1 -- 172.21.15.84:0/4203312338 wait complete. 2024-04-14T10:58:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.758+0000 7f6ce7fff640 1 -- 172.21.15.84:0/1959823714 --> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ce00057d0 con 0x7f6cd4074be0 2024-04-14T10:58:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.758+0000 7f6ccffff640 1 -- 172.21.15.84:0/1959823714 <== osd.3 v2:172.21.15.84:6800/895171386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ce00057d0 con 0x7f6cd4074be0 2024-04-14T10:58:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] conn(0x7f6cd4074be0 msgr2=0x7f6cd4077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f6ccdffb640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6800/895171386,v1:172.21.15.84:6801/895171386] conn(0x7f6cd4074be0 0x7f6cd4077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f3383fff640 1 -- 172.21.15.84:0/904374989 --> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f33a0069c30 con 0x7f3384074b90 2024-04-14T10:58:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f6cd406c9c0 msgr2=0x7f6cd406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f6ccdffb640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f6cd406c9c0 0x7f6cd406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8000f60 tx=0x7f6cd8009040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce00d2ba0 msgr2=0x7f6ce00cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f6ccdffb640 1 --2- 172.21.15.84:0/1959823714 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ce00d2ba0 0x7f6ce00cd110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc035000 tx=0x7f6cdc0046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.759+0000 7f33967fc640 1 -- 172.21.15.84:0/904374989 <== osd.2 v2:172.21.15.84:6824/3317034191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f33a0069c30 con 0x7f3384074b90 2024-04-14T10:58:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f6ce77fe640 1 -- 172.21.15.84:0/1959823714 reap_dead start 2024-04-14T10:58:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] conn(0x7f3384074b90 msgr2=0x7f3384076fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6824/3317034191,v1:172.21.15.84:6825/3317034191] conn(0x7f3384074b90 0x7f3384076fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 shutdown_connections 2024-04-14T10:58:10.811 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 >> 172.21.15.84:0/1959823714 conn(0x7f6ce000d180 msgr2=0x7f6ce004f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f338406c9f0 msgr2=0x7f338406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f338406c9f0 0x7f338406eeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f339c006fd0 tx=0x7f339c008040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b5050 msgr2=0x7f33a01f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 --2- 172.21.15.84:0/904374989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33a00b5050 0x7f33a01f6a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f339800c7b0 tx=0x7f339800cc70 comp rx=0 tx=0).stop 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a621d640 1 -- 172.21.15.84:0/904374989 reap_dead start 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 shutdown_connections 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.760+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 >> 172.21.15.84:0/904374989 conn(0x7f33a006b900 msgr2=0x7f33a0162d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.761+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 shutdown_connections 2024-04-14T10:58:10.812 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.761+0000 7f33a7c80640 1 -- 172.21.15.84:0/904374989 wait complete. 2024-04-14T10:58:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.762+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 shutdown_connections 2024-04-14T10:58:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.762+0000 7f6ccdffb640 1 -- 172.21.15.84:0/1959823714 wait complete. 2024-04-14T10:58:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.761+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 --> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b7c0699a0 con 0x7f5b5c074b90 2024-04-14T10:58:10.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.762+0000 7f828738b640 1 -- 172.21.15.84:0/2503424221 --> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f827804c510 con 0x7f8264074bf0 2024-04-14T10:58:10.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.762+0000 7f8272ffd640 1 -- 172.21.15.84:0/2503424221 <== osd.0 v2:172.21.15.84:6804/4267696951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f827804c510 con 0x7f8264074bf0 2024-04-14T10:58:10.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.762+0000 7f5b737fe640 1 -- 172.21.15.84:0/227829711 <== osd.5 v2:172.21.15.175:6824/1825582812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b7c0699a0 con 0x7f5b5c074b90 2024-04-14T10:58:10.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] conn(0x7f5b5c074b90 msgr2=0x7f5b5c076fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:6824/1825582812,v1:172.21.15.175:6825/1825582812] conn(0x7f5b5c074b90 0x7f5b5c076fb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] conn(0x7f8264074bf0 msgr2=0x7f8264077010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f8270ff9640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6804/4267696951,v1:172.21.15.84:6806/4267696951] conn(0x7f8264074bf0 0x7f8264077010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5b5c06c9f0 msgr2=0x7f5b5c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5b5c06c9f0 0x7f5b5c06eeb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b64036000 tx=0x7f5b64030000 comp rx=0 tx=0).stop 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 msgr2=0x7f5b7c0c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 --2- 172.21.15.84:0/227829711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b7c071730 0x7f5b7c0c4640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400ebe0 tx=0x7f5b7400c520 comp rx=0 tx=0).stop 2024-04-14T10:58:10.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b7b7fe640 1 -- 172.21.15.84:0/227829711 reap_dead start 2024-04-14T10:58:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f826406c970 msgr2=0x7f826406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f8270ff9640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f826406c970 0x7f826406ee30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f82740011e0 tx=0x7f8274009040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 msgr2=0x7f82780de4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f8270ff9640 1 --2- 172.21.15.84:0/2503424221 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82780dc690 0x7f82780de4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8280050b00 tx=0x7f828006cce0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 shutdown_connections 2024-04-14T10:58:10.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.763+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 >> 172.21.15.84:0/227829711 conn(0x7f5b7c06bd20 msgr2=0x7f5b7c0c2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f8286b8a640 1 -- 172.21.15.84:0/2503424221 reap_dead start 2024-04-14T10:58:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 shutdown_connections 2024-04-14T10:58:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 --> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b14002dd0 con 0x7f2b20074b40 2024-04-14T10:58:10.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 >> 172.21.15.84:0/2503424221 conn(0x7f8278050a00 msgr2=0x7f827804c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 shutdown_connections 2024-04-14T10:58:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 shutdown_connections 2024-04-14T10:58:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f5b8158c640 1 -- 172.21.15.84:0/227829711 wait complete. 2024-04-14T10:58:10.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.764+0000 7f8270ff9640 1 -- 172.21.15.84:0/2503424221 wait complete. 2024-04-14T10:58:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.765+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 --> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9eec069a10 con 0x7f9ed8074b60 2024-04-14T10:58:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.765+0000 7f2b1b7fe640 1 -- 172.21.15.84:0/2489965635 <== osd.4 v2:172.21.15.175:6816/324857761 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2b14002dd0 con 0x7f2b20074b40 2024-04-14T10:58:10.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.765+0000 7f9ed3fff640 1 -- 172.21.15.84:0/2236440860 <== osd.6 v2:172.21.15.175:6801/1284380825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9eec069a10 con 0x7f9ed8074b60 2024-04-14T10:58:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f4e1fbcc640 1 -- 172.21.15.84:0/4224062820 --> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e00002d50 con 0x7f4dfc074bc0 2024-04-14T10:58:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] conn(0x7f2b20074b40 msgr2=0x7f2b20076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:6816/324857761,v1:172.21.15.175:6817/324857761] conn(0x7f2b20074b40 0x7f2b20076f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2b2006c940 msgr2=0x7f2b2006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2b2006c940 0x7f2b2006ee00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b3402db70 tx=0x7f2b3406e040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b2c006ae0 msgr2=0x7f2b2c163070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 --2- 172.21.15.84:0/2489965635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b2c006ae0 0x7f2b2c163070 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800dad0 tx=0x7f2b2800df90 comp rx=0 tx=0).stop 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b337fe640 1 -- 172.21.15.84:0/2489965635 reap_dead start 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 shutdown_connections 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 >> 172.21.15.84:0/2489965635 conn(0x7f2b2c04d4e0 msgr2=0x7f2b2c035e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 shutdown_connections 2024-04-14T10:58:10.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f2b397fa640 1 -- 172.21.15.84:0/2489965635 wait complete. 2024-04-14T10:58:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f4e0e7fc640 1 -- 172.21.15.84:0/4224062820 <== osd.1 v2:172.21.15.84:6816/2733326547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4e00002d50 con 0x7f4dfc074bc0 2024-04-14T10:58:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] conn(0x7f9ed8074b60 msgr2=0x7f9ed8076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.766+0000 7f9ef1876640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.175:6801/1284380825,v1:172.21.15.175:6803/1284380825] conn(0x7f9ed8074b60 0x7f9ed8076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9ed806c940 msgr2=0x7f9ed806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9ed806c940 0x7f9ed806ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0099c0 tx=0x7f9edc008040 comp rx=0 tx=0).stop 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9eec072e50 msgr2=0x7f9eec15a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 --2- 172.21.15.84:0/2236440860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9eec072e50 0x7f9eec15a7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000e810 tx=0x7f9ee000ecd0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9eebfff640 1 -- 172.21.15.84:0/2236440860 reap_dead start 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 shutdown_connections 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 >> 172.21.15.84:0/2236440860 conn(0x7f9eec0ca330 msgr2=0x7f9eec06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] conn(0x7f4dfc074bc0 msgr2=0x7f4dfc076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f4dfbfff640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6816/2733326547,v1:172.21.15.84:6817/2733326547] conn(0x7f4dfc074bc0 0x7f4dfc076fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 shutdown_connections 2024-04-14T10:58:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.767+0000 7f9ef1876640 1 -- 172.21.15.84:0/2236440860 wait complete. 2024-04-14T10:58:10.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4dfc06c9c0 msgr2=0x7f4dfc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4dfc06c9c0 0x7f4dfc06ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009c00 tx=0x7f4e14009190 comp rx=0 tx=0).stop 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e18073820 msgr2=0x7f4e180c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 --2- 172.21.15.84:0/4224062820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e18073820 0x7f4e180c4bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e18068660 tx=0x7f4e080046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4e1e169640 1 -- 172.21.15.84:0/4224062820 reap_dead start 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 shutdown_connections 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 >> 172.21.15.84:0/4224062820 conn(0x7f4e180cc150 msgr2=0x7f4e180cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 shutdown_connections 2024-04-14T10:58:10.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:10.768+0000 7f4dfbfff640 1 -- 172.21.15.84:0/4224062820 wait complete. 2024-04-14T10:58:10.826 INFO:teuthology.orchestra.run.smithi084.stdout:55834574853 2024-04-14T10:58:10.826 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T10:58:10.827 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:10.827 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T10:58:10.828 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2024-04-14T10:58:10.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T10:58:10.829 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:10.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T10:58:10.830 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:10.831 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T10:58:10.831 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:10.832 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T10:58:10.833 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2024-04-14T10:58:10.833 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T10:58:10.834 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2024-04-14T10:58:10.834 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.035+0000 7fa30edad640 1 Processor -- start 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.036+0000 7fa30edad640 1 -- start start 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30edad640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa308150f00 0x7fa308072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30edad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa308072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30edad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3080c9760 con 0x7fa308071a00 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30edad640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa308073130 con 0x7fa308150f00 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30edad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa308156bb0 con 0x7fa308072c40 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30ddab640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa308150f00 0x7fa308072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30ddab640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa308150f00 0x7fa308072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34756/0 (socket says 172.21.15.84:34756) 2024-04-14T10:58:11.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.037+0000 7fa30ddab640 1 -- 172.21.15.84:0/3502625704 learned_addr learned my addr 172.21.15.84:0/3502625704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.038+0000 7fa30d5aa640 1 --2- 172.21.15.84:0/3502625704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa308072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.038+0000 7fa30ddab640 1 -- 172.21.15.84:0/3502625704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 msgr2=0x7fa308072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.038+0000 7fa30ddab640 1 --2- 172.21.15.84:0/3502625704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa308072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.038+0000 7fa30ddab640 1 -- 172.21.15.84:0/3502625704 >> v1:172.21.15.175:6789/0 conn(0x7fa308071a00 legacy=0x7fa30815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.038+0000 7fa30ddab640 1 -- 172.21.15.84:0/3502625704 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa308156e90 con 0x7fa308150f00 2024-04-14T10:58:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.039+0000 7f9b7e480640 1 Processor -- start 2024-04-14T10:58:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.039+0000 7feec0ade640 1 Processor -- start 2024-04-14T10:58:11.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.039+0000 7feec0ade640 1 -- start start 2024-04-14T10:58:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.039+0000 7f4b51fba640 1 Processor -- start 2024-04-14T10:58:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7fa30ddab640 1 --2- 172.21.15.84:0/3502625704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308150f00 0x7fa308072120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009870 tx=0x7fa2f802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80faf58cb4342ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7efd8a759640 1 Processor -- start 2024-04-14T10:58:11.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7f166bead640 1 Processor -- start 2024-04-14T10:58:11.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.039+0000 7f4b51fba640 1 -- start start 2024-04-14T10:58:11.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7f166bead640 1 -- start start 2024-04-14T10:58:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7f319ffff640 1 Processor -- start 2024-04-14T10:58:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7fa30cda9640 1 -- 172.21.15.84:0/3502625704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8034070 con 0x7fa308150f00 2024-04-14T10:58:11.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7fa30cda9640 1 -- 172.21.15.84:0/3502625704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8030840 con 0x7fa308150f00 2024-04-14T10:58:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7f319ffff640 1 -- start start 2024-04-14T10:58:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.039+0000 7f9b7e480640 1 -- start start 2024-04-14T10:58:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7f9b7e480640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b78159070 0x7f9b780cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.040+0000 7f9b7e480640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b780c6be0 0x7f9b780ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feec0ade640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feebc06f4f0 0x7feebc15fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feec0ade640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feebc0c73c0 con 0x7feebc06ffe0 2024-04-14T10:58:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feec0ade640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feebc0c7fd0 con 0x7feebc162540 2024-04-14T10:58:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feec0ade640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7feebc0c69d0 con 0x7feebc06f4f0 2024-04-14T10:58:11.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b51fba640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b4c0cc1e0 0x7f4b4c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b77fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b78159070 0x7f9b780cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b7e480640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b78159450 0x7f9b7815f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b7e480640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9b78072ce0 con 0x7f9b78159450 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b7e480640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9b78072fc0 con 0x7f9b78159070 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b7e480640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7806e750 con 0x7f9b780c6be0 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b77fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b78159070 0x7f9b780cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37512/0 (socket says 172.21.15.84:37512) 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b77fff640 1 -- 172.21.15.84:0/4237717940 learned_addr learned my addr 172.21.15.84:0/4237717940 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f9b7ca1d640 1 --2- 172.21.15.84:0/4237717940 >> v2:172.21.15.84:3300/0 conn(0x7f9b78159450 0x7f9b7815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b50fb8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b4c0cc1e0 0x7f4b4c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b50fb8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4b4c0cc1e0 0x7f4b4c150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34790/0 (socket says 172.21.15.84:34790) 2024-04-14T10:58:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b50fb8640 1 -- 172.21.15.84:0/2388900024 learned_addr learned my addr 172.21.15.84:0/2388900024 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b51fba640 1 --2- 172.21.15.84:0/2388900024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feeba59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feebc06f4f0 0x7feebc15fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feeba59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feebc06f4f0 0x7feebc15fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34782/0 (socket says 172.21.15.84:34782) 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7feeba59c640 1 -- 172.21.15.84:0/3494016853 learned_addr learned my addr 172.21.15.84:0/3494016853 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b4c073130 con 0x7f4b4c071a00 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4b4c156bb0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4c156e90 con 0x7f4b4c072c40 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f4b4bfff640 1 --2- 172.21.15.84:0/2388900024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7fa30edad640 1 -- 172.21.15.84:0/3502625704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308150f00 msgr2=0x7fa308072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7fa30edad640 1 --2- 172.21.15.84:0/3502625704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308150f00 0x7fa308072120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009870 tx=0x7fa2f802b980 comp rx=0 tx=0).stop 2024-04-14T10:58:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.041+0000 7f166bead640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1664157280 0x7f16641576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7feeba59c640 1 -- 172.21.15.84:0/3494016853 >> v1:172.21.15.175:6789/0 conn(0x7feebc162540 legacy=0x7feebc06f8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-14T10:58:11.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7feeba59c640 1 -- 172.21.15.84:0/3494016853 >> v1:172.21.15.84:6789/0 conn(0x7feebc06ffe0 legacy=0x7feebc1698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f166bead640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f16640cc070 0x7f16640cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f1669c49640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1664150ef0 0x7f1664073220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:59776/0 (socket says 172.21.15.84:59776) 2024-04-14T10:58:11.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f1669c49640 1 -- 172.21.15.84:0/3073273268 learned_addr learned my addr 172.21.15.84:0/3073273268 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166415a4f0 con 0x7f1664150ef0 2024-04-14T10:58:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f1669448640 1 --2- 172.21.15.84:0/3073273268 >> v2:172.21.15.175:3300/0 conn(0x7f1664157280 0x7f16641576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f166415a2a0 con 0x7f16640cc070 2024-04-14T10:58:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f166415a7d0 con 0x7f1664157280 2024-04-14T10:58:11.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7efd8a759640 1 -- start start 2024-04-14T10:58:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7fa30edad640 1 -- 172.21.15.84:0/3502625704 shutdown_connections 2024-04-14T10:58:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7fa30edad640 1 --2- 172.21.15.84:0/3502625704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa308072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7fa30edad640 1 --2- 172.21.15.84:0/3502625704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308150f00 0x7fa308072120 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7fa30edad640 1 -- 172.21.15.84:0/3502625704 >> 172.21.15.84:0/3502625704 conn(0x7fa30806bd20 msgr2=0x7fa30806c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f9b777fe640 1 --2- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b780c6be0 0x7f9b780ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31980dc6a0 0x7f31980dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f31980db150 0x7f31980db5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319ffff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3198007350 con 0x7f31980d53b0 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319ffff640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f3198007630 con 0x7f31980db150 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319ffff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3198007910 con 0x7f31980dc6a0 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f166a44a640 1 --2- 172.21.15.84:0/3073273268 >> v2:172.21.15.84:3300/0 conn(0x7f16640cc070 0x7f16640cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f9b77fff640 1 -- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b780c6be0 msgr2=0x7f9b780ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f9b77fff640 1 --2- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b780c6be0 0x7f9b780ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319effd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f31980d53b0 0x7f3198006b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:59778/0 (socket says 172.21.15.84:59778) 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319effd640 1 -- 172.21.15.84:0/2121559042 learned_addr learned my addr 172.21.15.84:0/2121559042 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f319e7fc640 1 --2- 172.21.15.84:0/2121559042 >> v2:172.21.15.175:3300/0 conn(0x7f31980dc6a0 0x7f31980dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f4b4bfff640 1 -- 172.21.15.84:0/2388900024 >> v2:172.21.15.84:3300/0 conn(0x7f4b4c0cc1e0 msgr2=0x7f4b4c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f4b4bfff640 1 --2- 172.21.15.84:0/2388900024 >> v2:172.21.15.84:3300/0 conn(0x7f4b4c0cc1e0 0x7f4b4c150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f4b4bfff640 1 -- 172.21.15.84:0/2388900024 >> v1:172.21.15.84:6789/0 conn(0x7f4b4c071a00 legacy=0x7f4b4c15a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f4b4bfff640 1 -- 172.21.15.84:0/2388900024 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c157170 con 0x7f4b4c072c40 2024-04-14T10:58:11.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f1668c47640 1 -- 172.21.15.84:0/3073273268 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105211458 0 0) 0x7f166415a4f0 con 0x7f1664150ef0 2024-04-14T10:58:11.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f1668c47640 1 -- 172.21.15.84:0/3073273268 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1650005730 con 0x7f1664150ef0 2024-04-14T10:58:11.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7feeba59c640 1 -- 172.21.15.84:0/3494016853 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc0c82b0 con 0x7feebc06f4f0 2024-04-14T10:58:11.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7fc1b624b640 1 Processor -- start 2024-04-14T10:58:11.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f9b77fff640 1 -- 172.21.15.84:0/4237717940 >> v2:172.21.15.84:3300/0 conn(0x7f9b78159450 msgr2=0x7f9b7815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f9b77fff640 1 --2- 172.21.15.84:0/4237717940 >> v2:172.21.15.84:3300/0 conn(0x7f9b78159450 0x7f9b7815f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.042+0000 7f9b77fff640 1 -- 172.21.15.84:0/4237717940 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7806ea30 con 0x7f9b78159070 2024-04-14T10:58:11.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319dffb640 1 -- 172.21.15.84:0/2121559042 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073724367 0 0) 0x7f3198007350 con 0x7f31980d53b0 2024-04-14T10:58:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319dffb640 1 -- 172.21.15.84:0/2121559042 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3188003520 con 0x7f31980d53b0 2024-04-14T10:58:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f1669448640 1 -- 172.21.15.84:0/3073273268 >> v2:172.21.15.84:3300/0 conn(0x7f16640cc070 msgr2=0x7f16640cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f1669448640 1 --2- 172.21.15.84:0/3073273268 >> v2:172.21.15.84:3300/0 conn(0x7f16640cc070 0x7f16640cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f1669448640 1 -- 172.21.15.84:0/3073273268 >> v1:172.21.15.175:6789/0 conn(0x7f1664150ef0 legacy=0x7f1664073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f1669448640 1 -- 172.21.15.84:0/3073273268 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166415aab0 con 0x7f1664157280 2024-04-14T10:58:11.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319f7fe640 1 --2- 172.21.15.84:0/2121559042 >> v2:172.21.15.84:3300/0 conn(0x7f31980db150 0x7f31980db5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd8a759640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c04be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd8a759640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7efd7c0e3090 0x7efd7c0e3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd8a759640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7c046b70 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd8a759640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7efd7c045450 con 0x7efd7c0e3090 2024-04-14T10:58:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd8a759640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c045fd0 con 0x7efd7c04ba60 2024-04-14T10:58:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319dffb640 1 -- 172.21.15.84:0/2121559042 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 351382106 0 0) 0x7f3188003520 con 0x7f31980d53b0 2024-04-14T10:58:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319e7fc640 1 -- 172.21.15.84:0/2121559042 >> v2:172.21.15.84:3300/0 conn(0x7f31980db150 msgr2=0x7f31980db5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319e7fc640 1 --2- 172.21.15.84:0/2121559042 >> v2:172.21.15.84:3300/0 conn(0x7f31980db150 0x7f31980db5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319e7fc640 1 -- 172.21.15.84:0/2121559042 >> v1:172.21.15.175:6789/0 conn(0x7f31980d53b0 legacy=0x7f3198006b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f4b4bfff640 1 --2- 172.21.15.84:0/2388900024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c072120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097a0 tx=0x7f4b3c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=678449599dc7b2cc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f319e7fc640 1 -- 172.21.15.84:0/2121559042 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3198007bf0 con 0x7f31980dc6a0 2024-04-14T10:58:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd89757640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efd7c0dd3c0 0x7efd7c046460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:59790/0 (socket says 172.21.15.84:59790) 2024-04-14T10:58:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd89757640 1 -- 172.21.15.84:0/1048203155 learned_addr learned my addr 172.21.15.84:0/1048203155 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:11.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd89f58640 1 --2- 172.21.15.84:0/1048203155 >> v2:172.21.15.84:3300/0 conn(0x7efd7c0e3090 0x7efd7c0e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7efd88f56640 1 --2- 172.21.15.84:0/1048203155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c04be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f4b4b7fe640 1 -- 172.21.15.84:0/2388900024 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c035020 con 0x7f4b4c072c40 2024-04-14T10:58:11.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f4b4b7fe640 1 -- 172.21.15.84:0/2388900024 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c031810 con 0x7f4b4c072c40 2024-04-14T10:58:11.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7f9b77fff640 1 --2- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159070 0x7f9b780cc600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b7806db80 tx=0x7f9b7002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11076647b57a7a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f4b4b7fe640 1 -- 172.21.15.84:0/2388900024 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c031be0 con 0x7f4b4c072c40 2024-04-14T10:58:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.043+0000 7fc1b624b640 1 -- start start 2024-04-14T10:58:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f9b76ffd640 1 -- 172.21.15.84:0/4237717940 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7002cb00 con 0x7f9b78159070 2024-04-14T10:58:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f9b76ffd640 1 -- 172.21.15.84:0/4237717940 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7002cca0 con 0x7f9b78159070 2024-04-14T10:58:11.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f9b76ffd640 1 -- 172.21.15.84:0/4237717940 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70034610 con 0x7f9b78159070 2024-04-14T10:58:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b624b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1b01591a0 0x7fc1b015f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b624b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b0162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b624b640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b00681a0 con 0x7fc1b0159580 2024-04-14T10:58:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b624b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b0162af0 con 0x7fc1b01591a0 2024-04-14T10:58:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b624b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b0162520 con 0x7fc1b00c71d0 2024-04-14T10:58:11.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f1669448640 1 --2- 172.21.15.84:0/3073273268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1664157280 0x7f16641576a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1664154960 tx=0x7f165402bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b545caef9d07fedc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7feeba59c640 1 --2- 172.21.15.84:0/3494016853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06f4f0 0x7feebc15fa50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feeac009870 tx=0x7feeac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27f3022ae691ac server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7feeb959a640 1 -- 172.21.15.84:0/3494016853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac034070 con 0x7feebc06f4f0 2024-04-14T10:58:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7feeb959a640 1 -- 172.21.15.84:0/3494016853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeac030860 con 0x7feebc06f4f0 2024-04-14T10:58:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7feeb959a640 1 -- 172.21.15.84:0/3494016853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac030c30 con 0x7feebc06f4f0 2024-04-14T10:58:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b5249640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1b01591a0 0x7fc1b015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b5249640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc1b01591a0 0x7fc1b015f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37536/0 (socket says 172.21.15.84:37536) 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b5249640 1 -- 172.21.15.84:0/2218210242 learned_addr learned my addr 172.21.15.84:0/2218210242 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b4a48640 1 --1- 172.21.15.84:0/2218210242 >> v1:172.21.15.84:6789/0 conn(0x7fc1b0159580 0x7fc1b00cd250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:34340/0 (socket says 172.21.15.84:34340) 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7fc1b5a4a640 1 --2- 172.21.15.84:0/2218210242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b0162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f1668c47640 1 -- 172.21.15.84:0/3073273268 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654039070 con 0x7f1664157280 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f1668c47640 1 -- 172.21.15.84:0/3073273268 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165402c940 con 0x7f1664157280 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f1668c47640 1 -- 172.21.15.84:0/3073273268 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165402cd10 con 0x7f1664157280 2024-04-14T10:58:11.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7f319e7fc640 1 --2- 172.21.15.84:0/2121559042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980dc6a0 0x7f31980dcac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3198008de0 tx=0x7f319402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9987f3bbf308115f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7efd89f58640 1 -- 172.21.15.84:0/1048203155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 msgr2=0x7efd7c04be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7efd89f58640 1 --2- 172.21.15.84:0/1048203155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c04be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7fc1b5a4a640 1 -- 172.21.15.84:0/2218210242 >> v2:172.21.15.175:3300/0 conn(0x7fc1b01591a0 msgr2=0x7fc1b015f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:11.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7fc1b5a4a640 1 --2- 172.21.15.84:0/2218210242 >> v2:172.21.15.175:3300/0 conn(0x7fc1b01591a0 0x7fc1b015f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7fc1b5a4a640 1 -- 172.21.15.84:0/2218210242 >> v1:172.21.15.84:6789/0 conn(0x7fc1b0159580 legacy=0x7fc1b00cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f319dffb640 1 -- 172.21.15.84:0/2121559042 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194038070 con 0x7f31980dc6a0 2024-04-14T10:58:11.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 msgr2=0x7f4b4c072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 --2- 172.21.15.84:0/2388900024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c072120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0097a0 tx=0x7f4b3c02b8b0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f319dffb640 1 -- 172.21.15.84:0/2121559042 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3194033440 con 0x7f31980dc6a0 2024-04-14T10:58:11.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 shutdown_connections 2024-04-14T10:58:11.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 --2- 172.21.15.84:0/2388900024 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c072120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 --2- 172.21.15.84:0/2388900024 >> v2:172.21.15.84:3300/0 conn(0x7f4b4c0cc1e0 0x7f4b4c150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 >> 172.21.15.84:0/2388900024 conn(0x7f4b4c06bd20 msgr2=0x7f4b4c06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7fa30edad640 1 -- 172.21.15.84:0/3502625704 shutdown_connections 2024-04-14T10:58:11.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 shutdown_connections 2024-04-14T10:58:11.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f9b7e480640 1 -- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159070 msgr2=0x7f9b780cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f9b7e480640 1 --2- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159070 0x7f9b780cc600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9b7806db80 tx=0x7f9b7002bf60 comp rx=0 tx=0).stop 2024-04-14T10:58:11.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7fc1b5a4a640 1 -- 172.21.15.84:0/2218210242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b0068480 con 0x7fc1b00c71d0 2024-04-14T10:58:11.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1664157280 msgr2=0x7f16641576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f166bead640 1 --2- 172.21.15.84:0/3073273268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1664157280 0x7f16641576a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1664154960 tx=0x7f165402bb90 comp rx=0 tx=0).stop 2024-04-14T10:58:11.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f4b51fba640 1 -- 172.21.15.84:0/2388900024 wait complete. 2024-04-14T10:58:11.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7efd89f58640 1 -- 172.21.15.84:0/1048203155 >> v1:172.21.15.175:6789/0 conn(0x7efd7c0dd3c0 legacy=0x7efd7c046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.044+0000 7efd89f58640 1 -- 172.21.15.84:0/1048203155 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c0dd7a0 con 0x7efd7c0e3090 2024-04-14T10:58:11.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7efd89f58640 1 --2- 172.21.15.84:0/1048203155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0e3520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd84074900 tx=0x7efd840a7af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee0d5c91a6667ac server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7efd77fff640 1 -- 172.21.15.84:0/1048203155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840a9970 con 0x7efd7c0e3090 2024-04-14T10:58:11.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 shutdown_connections 2024-04-14T10:58:11.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f166bead640 1 --2- 172.21.15.84:0/3073273268 >> v2:172.21.15.84:3300/0 conn(0x7f16640cc070 0x7f16640cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f166bead640 1 --2- 172.21.15.84:0/3073273268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1664157280 0x7f16641576a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 >> 172.21.15.84:0/3073273268 conn(0x7f166406b900 msgr2=0x7f166406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7efd77fff640 1 -- 172.21.15.84:0/1048203155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840a9b10 con 0x7efd7c0e3090 2024-04-14T10:58:11.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7efd77fff640 1 -- 172.21.15.84:0/1048203155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840a9970 con 0x7efd7c0e3090 2024-04-14T10:58:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7fa30edad640 1 -- 172.21.15.84:0/3502625704 wait complete. 2024-04-14T10:58:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 shutdown_connections 2024-04-14T10:58:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f166bead640 1 -- 172.21.15.84:0/3073273268 wait complete. 2024-04-14T10:58:11.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7fc1b5a4a640 1 --2- 172.21.15.84:0/2218210242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b0162f80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0097a0 tx=0x7fc1ac02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7602b72780b9402 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7fc1a7fff640 1 -- 172.21.15.84:0/2218210242 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac037070 con 0x7fc1b00c71d0 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7fc1a7fff640 1 -- 172.21.15.84:0/2218210242 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac030710 con 0x7fc1b00c71d0 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7fc1a7fff640 1 -- 172.21.15.84:0/2218210242 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac030ae0 con 0x7fc1b00c71d0 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7feec0ade640 1 -- 172.21.15.84:0/3494016853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06f4f0 msgr2=0x7feebc15fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7feec0ade640 1 --2- 172.21.15.84:0/3494016853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06f4f0 0x7feebc15fa50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feeac009870 tx=0x7feeac02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7feec0ade640 1 -- 172.21.15.84:0/3494016853 shutdown_connections 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7feec0ade640 1 --2- 172.21.15.84:0/3494016853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06f4f0 0x7feebc15fa50 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feeac009870 tx=0x7feeac02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7feec0ade640 1 -- 172.21.15.84:0/3494016853 >> 172.21.15.84:0/3494016853 conn(0x7feebc06b900 msgr2=0x7feebc06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.045+0000 7f319dffb640 1 -- 172.21.15.84:0/2121559042 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190001670 con 0x7f31980dc6a0 2024-04-14T10:58:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 -- 172.21.15.84:0/2121559042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980dc6a0 msgr2=0x7f31980dcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 --2- 172.21.15.84:0/2121559042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980dc6a0 0x7f31980dcac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3198008de0 tx=0x7f319402b7a0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 -- 172.21.15.84:0/2121559042 shutdown_connections 2024-04-14T10:58:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f9b7e480640 1 -- 172.21.15.84:0/4237717940 shutdown_connections 2024-04-14T10:58:11.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f9b7e480640 1 --2- 172.21.15.84:0/4237717940 >> v2:172.21.15.84:3300/0 conn(0x7f9b78159450 0x7f9b7815f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f9b7e480640 1 --2- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b780c6be0 0x7f9b780ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f9b7e480640 1 --2- 172.21.15.84:0/4237717940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159070 0x7f9b780cc600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f9b7e480640 1 -- 172.21.15.84:0/4237717940 >> 172.21.15.84:0/4237717940 conn(0x7f9b7806bd20 msgr2=0x7f9b7806c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 --2- 172.21.15.84:0/2121559042 >> v2:172.21.15.84:3300/0 conn(0x7f31980db150 0x7f31980db5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 --2- 172.21.15.84:0/2121559042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980dc6a0 0x7f31980dcac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 -- 172.21.15.84:0/2121559042 >> 172.21.15.84:0/2121559042 conn(0x7f3198050a10 msgr2=0x7f3198050e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 -- 172.21.15.84:0/2121559042 shutdown_connections 2024-04-14T10:58:11.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f319ffff640 1 -- 172.21.15.84:0/2121559042 wait complete. 2024-04-14T10:58:11.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7f4b51fba640 1 Processor -- start 2024-04-14T10:58:11.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7efd8a759640 1 -- 172.21.15.84:0/1048203155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 msgr2=0x7efd7c0e3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7efd8a759640 1 --2- 172.21.15.84:0/1048203155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0e3520 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd84074900 tx=0x7efd840a7af0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.046+0000 7feec0ade640 1 -- 172.21.15.84:0/3494016853 shutdown_connections 2024-04-14T10:58:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7efd8a759640 1 -- 172.21.15.84:0/1048203155 shutdown_connections 2024-04-14T10:58:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7efd8a759640 1 --2- 172.21.15.84:0/1048203155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0e3520 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7efd8a759640 1 --2- 172.21.15.84:0/1048203155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c04be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7efd8a759640 1 -- 172.21.15.84:0/1048203155 >> 172.21.15.84:0/1048203155 conn(0x7efd7c050180 msgr2=0x7efd7c050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7f4b51fba640 1 -- start start 2024-04-14T10:58:11.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7feec0ade640 1 -- 172.21.15.84:0/3494016853 wait complete. 2024-04-14T10:58:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 -- 172.21.15.84:0/2218210242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 msgr2=0x7fc1b0162f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 --2- 172.21.15.84:0/2218210242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b0162f80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0097a0 tx=0x7fc1ac02b790 comp rx=0 tx=0).stop 2024-04-14T10:58:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7efd8a759640 1 -- 172.21.15.84:0/1048203155 shutdown_connections 2024-04-14T10:58:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 -- 172.21.15.84:0/2218210242 shutdown_connections 2024-04-14T10:58:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 --2- 172.21.15.84:0/2218210242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b0162f80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 --2- 172.21.15.84:0/2218210242 >> v2:172.21.15.175:3300/0 conn(0x7fc1b01591a0 0x7fc1b015f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 -- 172.21.15.84:0/2218210242 >> 172.21.15.84:0/2218210242 conn(0x7fc1b006e5e0 msgr2=0x7fc1b006e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fa30edad640 1 Processor -- start 2024-04-14T10:58:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 -- 172.21.15.84:0/2218210242 shutdown_connections 2024-04-14T10:58:11.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b51fba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c071a00 0x7f4b4c157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f166bead640 1 Processor -- start 2024-04-14T10:58:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f166bead640 1 -- start start 2024-04-14T10:58:11.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b51fba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b51fba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0cc1e0 0x7f4b4c142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b51fba640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c15a7a0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f319ffff640 1 Processor -- start 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b51fba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c1511d0 con 0x7f4b4c071a00 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b51fba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4c15a920 con 0x7f4b4c072c40 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b4bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b4bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45274/0 (socket says 172.21.15.84:45274) 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b4bfff640 1 -- 172.21.15.84:0/3753303413 learned_addr learned my addr 172.21.15.84:0/3753303413 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b50fb8640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c071a00 0x7f4b4c157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b517b9640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0cc1e0 0x7f4b4c142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fc1b624b640 1 -- 172.21.15.84:0/2218210242 wait complete. 2024-04-14T10:58:11.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b517b9640 1 -- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 msgr2=0x7f4b4c146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f4b517b9640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c146c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7fa30edad640 1 -- start start 2024-04-14T10:58:11.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7fa30edad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 0x7fa3080c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7fa30edad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa3081f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7fa30edad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa308150f00 0x7fa3080c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7fa30edad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa30815a7a0 con 0x7fa308071a00 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7fa30edad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa308157450 con 0x7fa308150f00 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30edad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa30815a920 con 0x7fa308072c40 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b517b9640 1 -- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c071a00 msgr2=0x7f4b4c157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b517b9640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c071a00 0x7f4b4c157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b517b9640 1 -- 172.21.15.84:0/3753303413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c149c40 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7f9b7e480640 1 -- 172.21.15.84:0/4237717940 shutdown_connections 2024-04-14T10:58:11.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30e5ac640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa308150f00 0x7fa3080c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.047+0000 7efd8a759640 1 -- 172.21.15.84:0/1048203155 wait complete. 2024-04-14T10:58:11.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7efd8a759640 1 Processor -- start 2024-04-14T10:58:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7feec0ade640 1 Processor -- start 2024-04-14T10:58:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7feec0ade640 1 -- start start 2024-04-14T10:58:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b517b9640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0cc1e0 0x7f4b4c142630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400c4d0 tx=0x7f4b4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 0x7fa3080c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 0x7fa3080c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34838/0 (socket says 172.21.15.84:34838) 2024-04-14T10:58:11.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 -- 172.21.15.84:0/1191171610 learned_addr learned my addr 172.21.15.84:0/1191171610 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fc1b624b640 1 Processor -- start 2024-04-14T10:58:11.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f166bead640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 0x7f16640c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.048+0000 7f319ffff640 1 -- start start 2024-04-14T10:58:11.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f166bead640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1664150ef0 0x7f1664145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980d53b0 0x7f31980dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f1669c49640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 0x7f16640c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f1669c49640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 0x7f16640c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:37566/0 (socket says 172.21.15.84:37566) 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 -- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 msgr2=0x7fa3081f57d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa3081f57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 -- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa308150f00 msgr2=0x7fa3080c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa308150f00 0x7fa3080c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30ddab640 1 -- 172.21.15.84:0/1191171610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3081f4d10 con 0x7fa308071a00 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f1669c49640 1 -- 172.21.15.84:0/3278011097 learned_addr learned my addr 172.21.15.84:0/3278011097 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fa30e5ac640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa308150f00 0x7fa3080c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:11.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f1669448640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1664150ef0 0x7f1664145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f166bead640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1664157280 0x7f16641ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31980db150 0x7f31980d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 0x7f3198034e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319ffff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31980dd000 con 0x7f31980db150 2024-04-14T10:58:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f166bead640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1664157be0 con 0x7f1664157280 2024-04-14T10:58:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f166bead640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f166415b070 con 0x7f16640cc070 2024-04-14T10:58:11.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fa30ddab640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 0x7fa3080c9fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009990 tx=0x7fa2f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f166bead640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1664072e00 con 0x7f1664150ef0 2024-04-14T10:58:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f166a44a640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1664157280 0x7f16641ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319ffff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31980081b0 con 0x7f31980d53b0 2024-04-14T10:58:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f9b7e480640 1 -- 172.21.15.84:0/4237717940 wait complete. 2024-04-14T10:58:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319ffff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f319804d200 con 0x7f31980dc6a0 2024-04-14T10:58:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f319f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 0x7f3198034e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 0x7f3198034e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45290/0 (socket says 172.21.15.84:45290) 2024-04-14T10:58:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 -- 172.21.15.84:0/4096800775 learned_addr learned my addr 172.21.15.84:0/4096800775 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7fc1b624b640 1 -- start start 2024-04-14T10:58:11.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319effd640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980d53b0 0x7f31980dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 -- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980d53b0 msgr2=0x7f31980dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44016020 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b44006d50 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b44003bb0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980d53b0 0x7f31980dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 -- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31980db150 msgr2=0x7f31980d2f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.049+0000 7efd8a759640 1 -- start start 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd8a759640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c182560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd8a759640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0dd3c0 0x7efd7c0db930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd8a759640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0d8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd8a759640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c045980 con 0x7efd7c0e3090 2024-04-14T10:58:11.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd8a759640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0456a0 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd8a759640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c045c60 con 0x7efd7c04ba60 2024-04-14T10:58:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd89757640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c182560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd89757640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c182560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45300/0 (socket says 172.21.15.84:45300) 2024-04-14T10:58:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd89757640 1 -- 172.21.15.84:0/318718176 learned_addr learned my addr 172.21.15.84:0/318718176 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7efd88f56640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0dd3c0 0x7efd7c0db930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7efd89f58640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319e7fc640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31980db150 0x7f31980d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31980db150 0x7f31980d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f319f7fe640 1 -- 172.21.15.84:0/4096800775 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31980c92c0 con 0x7f31980dc6a0 2024-04-14T10:58:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f319f7fe640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 0x7f3198034e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f31a0076480 tx=0x7f31a0069650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4c151b00 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4c1520c0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f1669c49640 1 -- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1664150ef0 msgr2=0x7f1664145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f1669c49640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1664150ef0 0x7f1664145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f1669c49640 1 -- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1664157280 msgr2=0x7f16641ebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7f1669c49640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1664157280 0x7f16641ebf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f1669c49640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16640c5a90 con 0x7f16640cc070 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f166a44a640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1664157280 0x7f16641ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f1669c49640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 0x7f16640c5350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1660001920 tx=0x7f1660001de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feec0ade640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06ffe0 0x7feebc1f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fc1b624b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b00ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fc1b624b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b01591a0 0x7fc1b0155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fc1b624b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b00cc6a0 0x7fc1b01f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fc1b624b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b00cdae0 con 0x7fc1b00cc6a0 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fc1b624b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b00cd960 con 0x7fc1b01591a0 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.050+0000 7fc1b624b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b006cf70 con 0x7fc1b00c71d0 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b00ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b00ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45312/0 (socket says 172.21.15.84:45312) 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 -- 172.21.15.84:0/148392614 learned_addr learned my addr 172.21.15.84:0/148392614 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feec0ade640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc162540 0x7feebc162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7efd88f56640 1 -- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 msgr2=0x7efd7c182560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7efd88f56640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c182560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7efd88f56640 1 -- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 msgr2=0x7efd7c0d8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7efd88f56640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0d8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7efd88f56640 1 -- 172.21.15.84:0/318718176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c0b1910 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feeba59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06ffe0 0x7feebc1f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feeba59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06ffe0 0x7feebc1f9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34886/0 (socket says 172.21.15.84:34886) 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feeba59c640 1 -- 172.21.15.84:0/3504395279 learned_addr learned my addr 172.21.15.84:0/3504395279 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8034040 con 0x7fa308071a00 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f802f7a0 con 0x7fa308071a00 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f802fb90 con 0x7fa308071a00 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30814fdd0 con 0x7fa308071a00 2024-04-14T10:58:11.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3081f4fd0 con 0x7fa308071a00 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f9b7e480640 1 Processor -- start 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5a4a640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b00cc6a0 0x7fc1b01f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 -- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b01591a0 msgr2=0x7fc1b0155ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b01591a0 0x7fc1b0155ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 -- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b00cc6a0 msgr2=0x7fc1b01f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b00cc6a0 0x7fc1b01f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7fc1b5249640 1 -- 172.21.15.84:0/148392614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b01617b0 con 0x7fc1b00c71d0 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feebc15c5b0 0x7feebc1e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feebad9d640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feebc15c5b0 0x7feebc1e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feebc15ff90 con 0x7feebc06ffe0 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feebc0c6260 con 0x7feebc162540 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feebc0c6540 con 0x7feebc15c5b0 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feeb9d9b640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc162540 0x7feebc162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7f9b7e480640 1 -- start start 2024-04-14T10:58:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600058b0 con 0x7f16640cc070 2024-04-14T10:58:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1660005a70 con 0x7f16640cc070 2024-04-14T10:58:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.051+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600070d0 con 0x7f16640cc070 2024-04-14T10:58:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7f166bead640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16640c5d70 con 0x7f16640cc070 2024-04-14T10:58:11.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b4c0699a0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7f166bead640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16641ef9b0 con 0x7f16640cc070 2024-04-14T10:58:11.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0095440 con 0x7f31980dc6a0 2024-04-14T10:58:11.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a00955e0 con 0x7f31980dc6a0 2024-04-14T10:58:11.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7fc1b5249640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b00ccbf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000e7e0 tx=0x7fc1a000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feeb9d9b640 1 -- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feebc15c5b0 msgr2=0x7feebc1e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feeb9d9b640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feebc15c5b0 0x7feebc1e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feeb9d9b640 1 -- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06ffe0 msgr2=0x7feebc1f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feeb9d9b640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06ffe0 0x7feebc1f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.052+0000 7feeb9d9b640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc1f9580 con 0x7feebc162540 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b7e480640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 0x7f9b7815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7efd88f56640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0dd3c0 0x7efd7c0db930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e850 tx=0x7efd7800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b7e480640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b78159070 0x7f9b780cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0017070 con 0x7fc1b00c71d0 2024-04-14T10:58:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b7e480640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159450 0x7f9b781f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b7e480640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9b780728e0 con 0x7f9b780c6be0 2024-04-14T10:58:11.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b7e480640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b78072760 con 0x7f9b78159450 2024-04-14T10:58:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b7e480640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9b78072a60 con 0x7f9b78159070 2024-04-14T10:58:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a000c870 con 0x7fc1b00c71d0 2024-04-14T10:58:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000f040 con 0x7fc1b00c71d0 2024-04-14T10:58:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7feeb9d9b640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc162540 0x7feebc162bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feeb400be50 tx=0x7feeb4009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b77fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 0x7f9b7815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b77fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 0x7f9b7815afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34896/0 (socket says 172.21.15.84:34896) 2024-04-14T10:58:11.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f9b77fff640 1 -- 172.21.15.84:0/2343533129 learned_addr learned my addr 172.21.15.84:0/2343533129 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:11.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00959b0 con 0x7f31980dc6a0 2024-04-14T10:58:11.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78017070 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4019070 con 0x7feebc162540 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feebc0c8e30 con 0x7feebc162540 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feebc1e90e0 con 0x7feebc162540 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb4014440 con 0x7feebc162540 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b7ca1d640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159450 0x7f9b781f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31980c95a0 con 0x7f31980dc6a0 2024-04-14T10:58:11.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3198036840 con 0x7f31980dc6a0 2024-04-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b77fff640 1 -- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b78159070 msgr2=0x7f9b780cb2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b77fff640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b78159070 0x7f9b780cb2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b77fff640 1 -- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159450 msgr2=0x7f9b781f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b77fff640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159450 0x7f9b781f8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b77fff640 1 -- 172.21.15.84:0/2343533129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7815d170 con 0x7f9b780c6be0 2024-04-14T10:58:11.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4014830 con 0x7feebc162540 2024-04-14T10:58:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c0ddb20 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7800c940 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78017070 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.053+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c0de0e0 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7f9b77fff640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 0x7f9b7815afe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b70036040 tx=0x7f9b70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1660007270 con 0x7f16640cc070 2024-04-14T10:58:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1664069b20 con 0x7f16640cc070 2024-04-14T10:58:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3198007350 con 0x7f31980dc6a0 2024-04-14T10:58:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31a0095b50 con 0x7f31980dc6a0 2024-04-14T10:58:11.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7f165a7fc640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f164806c940 0x7f164806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd7c005390 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f166008f8f0 con 0x7f16640cc070 2024-04-14T10:58:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feeb401c070 con 0x7feebc162540 2024-04-14T10:58:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7feeaaffd640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fee9c06c9f0 0x7fee9c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7feeba59c640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fee9c06c9f0 0x7fee9c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feeb408ba70 con 0x7feebc162540 2024-04-14T10:58:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b00cd130 con 0x7fc1b00c71d0 2024-04-14T10:58:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b01e9e80 con 0x7fc1b00c71d0 2024-04-14T10:58:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b440050d0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7f4b497fa640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4b2c06c9c0 0x7f4b2c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b4408b4d0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.056+0000 7f1669448640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f164806c940 0x7f164806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2f8037070 con 0x7fa308071a00 2024-04-14T10:58:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.054+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3080699a0 con 0x7fa308071a00 2024-04-14T10:58:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7fa2fe7fc640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa2ec06c9f0 0x7fa2ec06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.055+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa2f80ae180 con 0x7fa308071a00 2024-04-14T10:58:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7fa30d5aa640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa2ec06c9f0 0x7fa2ec06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea0005290 con 0x7feebc162540 2024-04-14T10:58:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd7801a070 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7f31877fe640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f318c06c9c0 0x7f318c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7efd75ffb640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efd6806caf0 0x7efd6806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7f4b50fb8640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4b2c06c9c0 0x7f4b2c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31a0107c50 con 0x7f31980dc6a0 2024-04-14T10:58:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b0068b70 con 0x7fc1b00c71d0 2024-04-14T10:58:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7f319effd640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f318c06c9c0 0x7f318c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efd7808b620 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.058+0000 7feeba59c640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fee9c06c9f0 0x7fee9c06eeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feeac02b9e0 tx=0x7feeac008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.058+0000 7efd89757640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efd6806caf0 0x7efd6806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.057+0000 7f1669448640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f164806c940 0x7f164806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1654036000 tx=0x7f1654030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.058+0000 7fa30d5aa640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa2ec06c9f0 0x7fa2ec06eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa300007130 tx=0x7fa3000072a0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.058+0000 7f319effd640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f318c06c9c0 0x7f318c06ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31900011e0 tx=0x7f3190009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.058+0000 7f4b50fb8640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4b2c06c9c0 0x7f4b2c06ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009bd0 tx=0x7f4b34009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.058+0000 7efd89757640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efd6806caf0 0x7efd6806efb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd80005880 tx=0x7efd80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.061+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70043020 con 0x7f9b780c6be0 2024-04-14T10:58:11.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.061+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7815b800 con 0x7f9b780c6be0 2024-04-14T10:58:11.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.061+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f4b44020020 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.061+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7815d900 con 0x7f9b780c6be0 2024-04-14T10:58:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.061+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f166005d740 con 0x7f16640cc070 2024-04-14T10:58:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.061+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f3198007350 con 0x7f31980dc6a0 2024-04-14T10:58:11.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.062+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b780699a0 con 0x7f9b780c6be0 2024-04-14T10:58:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.063+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1a001a070 con 0x7fc1b00c71d0 2024-04-14T10:58:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.064+0000 7fc1a5ffb640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc19406c9c0 0x7fc19406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.064+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1a008bcb0 con 0x7fc1b00c71d0 2024-04-14T10:58:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.064+0000 7fc1b4a48640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc19406c9c0 0x7fc19406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.065+0000 7fc1b4a48640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc19406c9c0 0x7fc19406ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1b01f8fa0 tx=0x7fc1a8007d20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.065+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7efd780593f0 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.066+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fa2f803e070 con 0x7fa308071a00 2024-04-14T10:58:11.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.066+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc1a005a030 con 0x7fc1b00c71d0 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.068+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7002ce50 con 0x7f9b780c6be0 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.068+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7003e450 con 0x7f9b780c6be0 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.068+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b70046020 con 0x7f9b780c6be0 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.069+0000 7f9b74ff9640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b5806c920 0x7f9b5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.069+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9b700ae700 con 0x7f9b780c6be0 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.071+0000 7f9b777fe640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b5806c920 0x7f9b5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:11.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.071+0000 7f9b777fe640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b5806c920 0x7f9b5806ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b78069740 tx=0x7f9b68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:11.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.070+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7feeb4059830 con 0x7feebc162540 2024-04-14T10:58:11.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.075+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f9b7004d030 con 0x7f9b780c6be0 2024-04-14T10:58:11.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.485+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f16640c4020 con 0x7f16640cc070 2024-04-14T10:58:11.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.485+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa308068b70 con 0x7fa308071a00 2024-04-14T10:58:11.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.486+0000 7fa2fe7fc640 1 -- 172.21.15.84:0/1191171610 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa2f807c590 con 0x7fa308071a00 2024-04-14T10:58:11.485 INFO:teuthology.orchestra.run.smithi084.stdout:55834574852 2024-04-14T10:58:11.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.486+0000 7f165a7fc640 1 -- 172.21.15.84:0/3278011097 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1660061a40 con 0x7f16640cc070 2024-04-14T10:58:11.486 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.486+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4b4c164520 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.487+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f31980057e0 con 0x7f31980dc6a0 2024-04-14T10:58:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.487+0000 7f4b497fa640 1 -- 172.21.15.84:0/3753303413 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b440592a0 con 0x7f4b4c0cc1e0 2024-04-14T10:58:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.487+0000 7f31877fe640 1 -- 172.21.15.84:0/4096800775 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31a00d60f0 con 0x7f31980dc6a0 2024-04-14T10:58:11.487 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2024-04-14T10:58:11.487 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa2ec06c9f0 msgr2=0x7fa2ec06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7fa30edad640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa2ec06c9f0 0x7fa2ec06eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa300007130 tx=0x7fa3000072a0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f164806c940 msgr2=0x7f164806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7f1647fff640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f164806c940 0x7f164806ee00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1654036000 tx=0x7f1654030000 comp rx=0 tx=0).stop 2024-04-14T10:58:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 msgr2=0x7fa3080c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 msgr2=0x7f16640c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.489+0000 7fa30edad640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 0x7fa3080c9fe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009990 tx=0x7fa2f80046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 0x7f16640c5350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1660001920 tx=0x7f1660001de0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 shutdown_connections 2024-04-14T10:58:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 shutdown_connections 2024-04-14T10:58:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f164806c940 0x7f164806ee00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1664157280 0x7f16641ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1664150ef0 0x7f1664145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 --2- 172.21.15.84:0/3278011097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16640cc070 0x7f16640c5350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 >> 172.21.15.84:0/3278011097 conn(0x7f166406b900 msgr2=0x7f16641468f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa2ec06c9f0 0x7fa2ec06eeb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa308150f00 0x7fa3080c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 shutdown_connections 2024-04-14T10:58:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa308072c40 0x7fa3081f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 --2- 172.21.15.84:0/1191171610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa308071a00 0x7fa3080c9fe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 >> 172.21.15.84:0/1191171610 conn(0x7fa30806bd20 msgr2=0x7fa3081482d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f1647fff640 1 -- 172.21.15.84:0/3278011097 wait complete. 2024-04-14T10:58:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 shutdown_connections 2024-04-14T10:58:11.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7fa30edad640 1 -- 172.21.15.84:0/1191171610 wait complete. 2024-04-14T10:58:11.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4b2c06c9c0 msgr2=0x7f4b2c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.490+0000 7f4b51fba640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4b2c06c9c0 0x7f4b2c06ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b34009bd0 tx=0x7f4b34009240 comp rx=0 tx=0).stop 2024-04-14T10:58:11.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0cc1e0 msgr2=0x7f4b4c142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0cc1e0 0x7f4b4c142630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400c4d0 tx=0x7f4b4400c990 comp rx=0 tx=0).stop 2024-04-14T10:58:11.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f318c06c9c0 msgr2=0x7f318c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f318c06c9c0 0x7f318c06ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31900011e0 tx=0x7f3190009040 comp rx=0 tx=0).stop 2024-04-14T10:58:11.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 msgr2=0x7f3198034e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 0x7f3198034e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f31a0076480 tx=0x7f31a0069650 comp rx=0 tx=0).stop 2024-04-14T10:58:11.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 shutdown_connections 2024-04-14T10:58:11.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4b2c06c9c0 0x7f4b2c06ee80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 shutdown_connections 2024-04-14T10:58:11.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b4c0cc1e0 0x7f4b4c142630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f318c06c9c0 0x7f318c06ee80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b4c072c40 0x7f4b4c146c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31980dc6a0 0x7f3198034e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31980db150 0x7f31980d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 --2- 172.21.15.84:0/3753303413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b4c071a00 0x7f4b4c157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 --2- 172.21.15.84:0/4096800775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31980d53b0 0x7f31980dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 >> 172.21.15.84:0/3753303413 conn(0x7f4b4c06bd20 msgr2=0x7f4b4c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 >> 172.21.15.84:0/4096800775 conn(0x7f3198050a10 msgr2=0x7f31980da8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 shutdown_connections 2024-04-14T10:58:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f319ffff640 1 -- 172.21.15.84:0/4096800775 wait complete. 2024-04-14T10:58:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 shutdown_connections 2024-04-14T10:58:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.491+0000 7f4b51fba640 1 -- 172.21.15.84:0/3753303413 wait complete. 2024-04-14T10:58:11.499 INFO:teuthology.orchestra.run.smithi084.stdout:55834574853 2024-04-14T10:58:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.494+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efd7c0dc1d0 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.495+0000 7efd75ffb640 1 -- 172.21.15.84:0/318718176 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd7805d6f0 con 0x7efd7c0dd3c0 2024-04-14T10:58:11.499 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2024-04-14T10:58:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.492+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc1b00cd390 con 0x7fc1b00c71d0 2024-04-14T10:58:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.493+0000 7fc1a5ffb640 1 -- 172.21.15.84:0/148392614 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc1a0059930 con 0x7fc1b00c71d0 2024-04-14T10:58:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.496+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc19406c9c0 msgr2=0x7fc19406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.496+0000 7fc1b624b640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc19406c9c0 0x7fc19406ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc1b01f8fa0 tx=0x7fc1a8007d20 comp rx=0 tx=0).stop 2024-04-14T10:58:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feea0005580 con 0x7feebc162540 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 msgr2=0x7fc1b00ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b00ccbf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000e7e0 tx=0x7fc1a000eca0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 shutdown_connections 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc19406c9c0 0x7fc19406ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b00cc6a0 0x7fc1b01f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1b01591a0 0x7fc1b0155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 --2- 172.21.15.84:0/148392614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc1b00c71d0 0x7fc1b00ccbf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 >> 172.21.15.84:0/148392614 conn(0x7fc1b006e5e0 msgr2=0x7fc1b00c43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 shutdown_connections 2024-04-14T10:58:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7feeaaffd640 1 -- 172.21.15.84:0/3504395279 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feeb405db30 con 0x7feebc162540 2024-04-14T10:58:11.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.497+0000 7fc1b624b640 1 -- 172.21.15.84:0/148392614 wait complete. 2024-04-14T10:58:11.503 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efd6806caf0 msgr2=0x7efd6806efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efd6806caf0 0x7efd6806efb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efd80005880 tx=0x7efd80009040 comp rx=0 tx=0).stop 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0dd3c0 msgr2=0x7efd7c0db930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0dd3c0 0x7efd7c0db930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e850 tx=0x7efd7800ed10 comp rx=0 tx=0).stop 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 shutdown_connections 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efd6806caf0 0x7efd6806efb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efd7c0e3090 0x7efd7c0d8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c0dd3c0 0x7efd7c0db930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 --2- 172.21.15.84:0/318718176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c04ba60 0x7efd7c182560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.499+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 >> 172.21.15.84:0/318718176 conn(0x7efd7c050180 msgr2=0x7efd7c006f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.500+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 shutdown_connections 2024-04-14T10:58:11.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.500+0000 7efd8a759640 1 -- 172.21.15.84:0/318718176 wait complete. 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fee9c06c9f0 msgr2=0x7fee9c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fee9c06c9f0 0x7fee9c06eeb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7feeac02b9e0 tx=0x7feeac008030 comp rx=0 tx=0).stop 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc162540 msgr2=0x7feebc162bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc162540 0x7feebc162bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feeb400be50 tx=0x7feeb4009f70 comp rx=0 tx=0).stop 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 shutdown_connections 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fee9c06c9f0 0x7fee9c06eeb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feebc15c5b0 0x7feebc1e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc162540 0x7feebc162bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 --2- 172.21.15.84:0/3504395279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feebc06ffe0 0x7feebc1f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 >> 172.21.15.84:0/3504395279 conn(0x7feebc06b900 msgr2=0x7feebc0c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 shutdown_connections 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.501+0000 7feec0ade640 1 -- 172.21.15.84:0/3504395279 wait complete. 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.505+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9b780c3360 con 0x7f9b780c6be0 2024-04-14T10:58:11.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.505+0000 7f9b74ff9640 1 -- 172.21.15.84:0/2343533129 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b7007cc30 con 0x7f9b780c6be0 2024-04-14T10:58:11.509 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b5806c920 msgr2=0x7f9b5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b5806c920 0x7f9b5806ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9b78069740 tx=0x7f9b68008040 comp rx=0 tx=0).stop 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 msgr2=0x7f9b7815afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 0x7f9b7815afe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9b70036040 tx=0x7f9b70004a40 comp rx=0 tx=0).stop 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 shutdown_connections 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b5806c920 0x7f9b5806ede0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b78159450 0x7f9b781f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b78159070 0x7f9b780cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 --2- 172.21.15.84:0/2343533129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b780c6be0 0x7f9b7815afe0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.509+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 >> 172.21.15.84:0/2343533129 conn(0x7f9b7806bd20 msgr2=0x7f9b78157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.510+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 shutdown_connections 2024-04-14T10:58:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:11.510+0000 7f9b7e480640 1 -- 172.21.15.84:0/2343533129 wait complete. 2024-04-14T10:58:11.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-14T10:58:11.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-14T10:58:11.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-14T10:58:11.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-04-14T10:58:11.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-14T10:58:11.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-14T10:58:11.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-14T10:58:11.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-14T10:58:12.514 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T10:58:12.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T10:58:12.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T10:58:12.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T10:58:12.520 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T10:58:12.521 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T10:58:12.524 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T10:58:12.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T10:58:12.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.676+0000 7feb1a7a5640 1 Processor -- start 2024-04-14T10:58:12.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.676+0000 7f2c431ad640 1 Processor -- start 2024-04-14T10:58:12.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.676+0000 7fc2c50c8640 1 Processor -- start 2024-04-14T10:58:12.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.677+0000 7fc2c50c8640 1 -- start start 2024-04-14T10:58:12.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.676+0000 7f2c431ad640 1 -- start start 2024-04-14T10:58:12.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7fc2c50c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2b80e0490 0x7fc2b8039e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7fc2c50c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b804ffd0 0x7fc2b80dfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7fc2c50c8640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b803a4b0 con 0x7fc2b80d9250 2024-04-14T10:58:12.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7f2c421ab640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2c340d6ca0 0x7f2c340dcac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48020/0 (socket says 172.21.15.84:48020) 2024-04-14T10:58:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7fc2c50c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b80dffe0 con 0x7fc2b80e0490 2024-04-14T10:58:12.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7fc2c50c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b804ef30 con 0x7fc2b804ffd0 2024-04-14T10:58:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7f2c421ab640 1 -- 172.21.15.84:0/3361410364 learned_addr learned my addr 172.21.15.84:0/3361410364 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7f2c431ad640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340e0d30 0x7f2c3404e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7f2c431ad640 1 --2- 172.21.15.84:0/3361410364 >> v2:172.21.15.175:3300/0 conn(0x7f2c34047270 0x7f2c3404d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7fc2be59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2b80e0490 0x7fc2b8039e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7fc2bf59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b804ffd0 0x7fc2b80dfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c429ac640 1 --2- 172.21.15.84:0/3361410364 >> v2:172.21.15.175:3300/0 conn(0x7f2c34047270 0x7f2c3404d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7fc2be59c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc2b80e0490 0x7fc2b8039e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43158/0 (socket says 172.21.15.84:43158) 2024-04-14T10:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7fc2be59c640 1 -- 172.21.15.84:0/3403682927 learned_addr learned my addr 172.21.15.84:0/3403682927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c419aa640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340e0d30 0x7f2c3404e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c340dd530 con 0x7f2c340d6ca0 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.678+0000 7feb1a7a5640 1 -- start start 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb1a7a5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb140ca470 0x7feb140c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb1a7a5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb140ca850 0x7feb141516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb1a7a5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb140c9540 con 0x7feb1406c170 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb1a7a5640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7feb140c97e0 con 0x7feb140ca470 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb1a7a5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7feb140c9aa0 con 0x7feb140ca850 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb13fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb140ca470 0x7feb140c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb13fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7feb140ca470 0x7feb140c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43162/0 (socket says 172.21.15.84:43162) 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb13fff640 1 -- 172.21.15.84:0/3239242022 learned_addr learned my addr 172.21.15.84:0/3239242022 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7feb137fe640 1 --2- 172.21.15.84:0/3239242022 >> v2:172.21.15.175:3300/0 conn(0x7feb140ca850 0x7feb141516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2c340dd810 con 0x7f2c34047270 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2c340e0250 con 0x7f2c340e0d30 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c411a9640 1 -- 172.21.15.84:0/3361410364 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110209267 0 0) 0x7f2c340dd530 con 0x7f2c340d6ca0 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c429ac640 1 -- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340e0d30 msgr2=0x7f2c3404e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c429ac640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340e0d30 0x7f2c3404e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c429ac640 1 -- 172.21.15.84:0/3361410364 >> v1:172.21.15.84:6789/0 conn(0x7f2c340d6ca0 legacy=0x7f2c340dcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.679+0000 7f2c429ac640 1 -- 172.21.15.84:0/3361410364 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c340e0530 con 0x7f2c34047270 2024-04-14T10:58:12.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7fc2be59c640 1 -- 172.21.15.84:0/3403682927 >> v2:172.21.15.175:3300/0 conn(0x7fc2b804ffd0 msgr2=0x7fc2b80dfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7fc2be59c640 1 --2- 172.21.15.84:0/3403682927 >> v2:172.21.15.175:3300/0 conn(0x7fc2b804ffd0 0x7fc2b80dfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7fc2be59c640 1 -- 172.21.15.84:0/3403682927 >> v1:172.21.15.84:6789/0 conn(0x7fc2b80d9250 legacy=0x7fc2b80071b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:58:12.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7fc2be59c640 1 -- 172.21.15.84:0/3403682927 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b804f210 con 0x7fc2b80e0490 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7feb137fe640 1 -- 172.21.15.84:0/3239242022 >> v2:172.21.15.84:3300/0 conn(0x7feb140ca470 msgr2=0x7feb140c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7feb137fe640 1 --2- 172.21.15.84:0/3239242022 >> v2:172.21.15.84:3300/0 conn(0x7feb140ca470 0x7feb140c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7feb137fe640 1 -- 172.21.15.84:0/3239242022 >> v1:172.21.15.175:6789/0 conn(0x7feb1406c170 legacy=0x7feb14157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.680+0000 7feb137fe640 1 -- 172.21.15.84:0/3239242022 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb140c6320 con 0x7feb140ca850 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.681+0000 7f2c429ac640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34047270 0x7f2c3404d180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c074900 tx=0x7f2c3c0abfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d95f59932069ce99 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.681+0000 7f2c411a9640 1 -- 172.21.15.84:0/3361410364 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0acb50 con 0x7f2c34047270 2024-04-14T10:58:12.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.681+0000 7f2c411a9640 1 -- 172.21.15.84:0/3361410364 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0acd30 con 0x7f2c34047270 2024-04-14T10:58:12.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.681+0000 7feb137fe640 1 --2- 172.21.15.84:0/3239242022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca850 0x7feb141516a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb1406d340 tx=0x7feb0402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a1c8118c261481 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.681+0000 7f2c411a9640 1 -- 172.21.15.84:0/3361410364 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c071670 con 0x7f2c34047270 2024-04-14T10:58:12.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7fc2be59c640 1 --2- 172.21.15.84:0/3403682927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80e0490 0x7fc2b8039e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0051650 tx=0x7fc2c00a7e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e22bbbcfc292ea server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7feb12ffd640 1 -- 172.21.15.84:0/3239242022 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04035020 con 0x7feb140ca850 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7feb12ffd640 1 -- 172.21.15.84:0/3239242022 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb04031640 con 0x7feb140ca850 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34047270 msgr2=0x7f2c3404d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34047270 0x7f2c3404d180 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c074900 tx=0x7f2c3c0abfb0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 shutdown_connections 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340e0d30 0x7f2c3404e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 --2- 172.21.15.84:0/3361410364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c34047270 0x7f2c3404d180 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 >> 172.21.15.84:0/3361410364 conn(0x7f2c3400e0c0 msgr2=0x7f2c3400e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7fc2bdd9b640 1 -- 172.21.15.84:0/3403682927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00b5070 con 0x7fc2b80e0490 2024-04-14T10:58:12.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7feb12ffd640 1 -- 172.21.15.84:0/3239242022 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0402d040 con 0x7feb140ca850 2024-04-14T10:58:12.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 shutdown_connections 2024-04-14T10:58:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3239242022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca850 msgr2=0x7feb141516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3239242022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca850 0x7feb141516a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb1406d340 tx=0x7feb0402b8f0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3239242022 shutdown_connections 2024-04-14T10:58:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3239242022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca850 0x7feb141516a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7fc2bdd9b640 1 -- 172.21.15.84:0/3403682927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c00a8ac0 con 0x7fc2b80e0490 2024-04-14T10:58:12.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7fc2bdd9b640 1 -- 172.21.15.84:0/3403682927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00b5070 con 0x7fc2b80e0490 2024-04-14T10:58:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3239242022 >> v2:172.21.15.84:3300/0 conn(0x7feb140ca470 0x7feb140c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.683+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3239242022 >> 172.21.15.84:0/3239242022 conn(0x7feb14070750 msgr2=0x7feb14070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3239242022 shutdown_connections 2024-04-14T10:58:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7fc2c50c8640 1 -- 172.21.15.84:0/3403682927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80e0490 msgr2=0x7fc2b8039e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/3403682927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80e0490 0x7fc2b8039e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0051650 tx=0x7fc2c00a7e60 comp rx=0 tx=0).stop 2024-04-14T10:58:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7fc2c50c8640 1 -- 172.21.15.84:0/3403682927 shutdown_connections 2024-04-14T10:58:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.682+0000 7f2c431ad640 1 -- 172.21.15.84:0/3361410364 wait complete. 2024-04-14T10:58:12.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7f2c431ad640 1 Processor -- start 2024-04-14T10:58:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/3403682927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80e0490 0x7fc2b8039e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/3403682927 >> v2:172.21.15.175:3300/0 conn(0x7fc2b804ffd0 0x7fc2b80dfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7fc2c50c8640 1 -- 172.21.15.84:0/3403682927 >> 172.21.15.84:0/3403682927 conn(0x7fc2b800e160 msgr2=0x7fc2b800e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.685+0000 7fc2c50c8640 1 -- 172.21.15.84:0/3403682927 shutdown_connections 2024-04-14T10:58:12.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7f2c431ad640 1 -- start start 2024-04-14T10:58:12.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.684+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3239242022 wait complete. 2024-04-14T10:58:12.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7feb1a7a5640 1 Processor -- start 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c431ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 0x7f2c340d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c421ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 0x7f2c340d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c421ab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 0x7f2c340d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43170/0 (socket says 172.21.15.84:43170) 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c431ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340d6ca0 0x7f2c3417c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c431ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c340e0d30 0x7f2c3417caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c431ad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340dd1d0 con 0x7f2c34047270 2024-04-14T10:58:12.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c431ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340476a0 con 0x7f2c340e0d30 2024-04-14T10:58:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.685+0000 7fc2c50c8640 1 -- 172.21.15.84:0/3403682927 wait complete. 2024-04-14T10:58:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7fc2c50c8640 1 Processor -- start 2024-04-14T10:58:12.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7fc2c50c8640 1 -- start start 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7feb1a7a5640 1 -- start start 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb1a7a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 0x7feb141f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb1a7a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca470 0x7feb141531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb1a7a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb140ca850 0x7feb14151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb1a7a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feb140c4c30 con 0x7feb1406c170 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb1a7a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb140c68e0 con 0x7feb140ca470 2024-04-14T10:58:12.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c431ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2c340d7080 con 0x7f2c340d6ca0 2024-04-14T10:58:12.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb1a7a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feb140c9120 con 0x7feb140ca850 2024-04-14T10:58:12.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.686+0000 7f2c421ab640 1 -- 172.21.15.84:0/2308762560 learned_addr learned my addr 172.21.15.84:0/2308762560 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7f2c419aa640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340d6ca0 0x7f2c3417c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb13fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 0x7feb141f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb13fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 0x7feb141f32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43176/0 (socket says 172.21.15.84:43176) 2024-04-14T10:58:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.687+0000 7feb13fff640 1 -- 172.21.15.84:0/3460274246 learned_addr learned my addr 172.21.15.84:0/3460274246 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7feb13fff640 1 -- 172.21.15.84:0/3460274246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb140ca850 msgr2=0x7feb14151bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:58:12.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7feb13fff640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb140ca850 0x7feb14151bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7fc2c50c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b804ffd0 0x7fc2b804cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7f2c421ab640 1 -- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340d6ca0 msgr2=0x7f2c3417c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7f2c421ab640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340d6ca0 0x7f2c3417c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7f2c421ab640 1 -- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c340e0d30 msgr2=0x7f2c3417caf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:58:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7f2c421ab640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c340e0d30 0x7f2c3417caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7fc2c50c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 0x7fc2b81691d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7feb13fff640 1 -- 172.21.15.84:0/3460274246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca470 msgr2=0x7feb141531d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:58:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7feb13fff640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca470 0x7feb141531d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7feb13fff640 1 -- 172.21.15.84:0/3460274246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb14154eb0 con 0x7feb1406c170 2024-04-14T10:58:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7f2c421ab640 1 -- 172.21.15.84:0/2308762560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c340dc520 con 0x7f2c34047270 2024-04-14T10:58:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.688+0000 7feb13fff640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 0x7feb141f32d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009fd0 tx=0x7feb0c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2be59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 0x7fc2b81691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2be59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 0x7fc2b81691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43182/0 (socket says 172.21.15.84:43182) 2024-04-14T10:58:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2be59c640 1 -- 172.21.15.84:0/1418898677 learned_addr learned my addr 172.21.15.84:0/1418898677 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80e0490 0x7fc2b8169710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c01a070 con 0x7feb1406c170 2024-04-14T10:58:12.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b804fab0 con 0x7fc2b80d9250 2024-04-14T10:58:12.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7f2c421ab640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 0x7f2c340d11b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c7b0 tx=0x7f2c3800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2bf59e640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80e0490 0x7fc2b8169710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b804f7d0 con 0x7fc2b804ffd0 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b8050420 con 0x7fc2b80e0490 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.690+0000 7fc2bf59e640 1 -- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b804ffd0 msgr2=0x7fc2b804cf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.690+0000 7fc2bf59e640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b804ffd0 0x7fc2b804cf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.690+0000 7fc2bf59e640 1 -- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 msgr2=0x7fc2b81691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.690+0000 7fc2bf59e640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 0x7fc2b81691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.690+0000 7fc2bf59e640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b81759a0 con 0x7fc2b80e0490 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7fc2be59c640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 0x7fc2b81691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:12.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38018070 con 0x7f2c34047270 2024-04-14T10:58:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7fc2bf59e640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80e0490 0x7fc2b8169710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400e5f0 tx=0x7fc2b400eab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c340ddf90 con 0x7f2c34047270 2024-04-14T10:58:12.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c340dc7c0 con 0x7f2c34047270 2024-04-14T10:58:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4017070 con 0x7fc2b80e0490 2024-04-14T10:58:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b4013680 con 0x7fc2b80e0490 2024-04-14T10:58:12.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.691+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b8007a70 con 0x7fc2b80e0490 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb141f3810 con 0x7feb1406c170 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.689+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb141526f0 con 0x7feb1406c170 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.692+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb0c00ddb0 con 0x7feb1406c170 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.692+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0c015640 con 0x7feb1406c170 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.693+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb0c01d070 con 0x7feb1406c170 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.694+0000 7feb10ff9640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7feaf406c9f0 0x7feaf406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.694+0000 7feb137fe640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7feaf406c9f0 0x7feaf406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.695+0000 7feb137fe640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7feaf406c9f0 0x7feaf406eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb04036000 tx=0x7feb04008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.695+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feb0c08ba60 con 0x7feb1406c170 2024-04-14T10:58:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.696+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf8005290 con 0x7feb1406c170 2024-04-14T10:58:12.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.692+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b80075c0 con 0x7fc2b80e0490 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.694+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4013a70 con 0x7fc2b80e0490 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.694+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2b401a070 con 0x7fc2b80e0490 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.695+0000 7fc2a77fe640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc2a806cb30 0x7fc2a806eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.695+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc2b408b5c0 con 0x7fc2b80e0490 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.695+0000 7fc2bed9d640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc2a806cb30 0x7fc2a806eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.696+0000 7fc2bed9d640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc2a806cb30 0x7fc2a806eff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00096c0 tx=0x7fc2b0006bb0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.696+0000 7fc2a57fa640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b80057e0 con 0x7fc2b80e0490 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.693+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c340057e0 con 0x7f2c34047270 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.696+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c380072d0 con 0x7f2c34047270 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.697+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800ce60 con 0x7f2c34047270 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.697+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c3801b070 con 0x7f2c34047270 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.697+0000 7f2c32ffd640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2c2006ca20 0x7f2c2006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.698+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2c3808b0b0 con 0x7f2c34047270 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.698+0000 7f2c419aa640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2c2006ca20 0x7f2c2006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.699+0000 7f2c419aa640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2c2006ca20 0x7f2c2006eee0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c34005d40 tx=0x7f2c2c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.703+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f2c38059430 con 0x7f2c34047270 2024-04-14T10:58:12.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.703+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc2b4059380 con 0x7fc2b80e0490 2024-04-14T10:58:12.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.711+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7feb0c010070 con 0x7feb1406c170 2024-04-14T10:58:12.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.732+0000 7f59a233a640 1 Processor -- start 2024-04-14T10:58:12.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.732+0000 7f59a233a640 1 -- start start 2024-04-14T10:58:12.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a233a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f599c0cc870 0x7f599c06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a233a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0c94a0 0x7f599c164890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a233a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c167b00 con 0x7f599c0ccc50 2024-04-14T10:58:12.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a233a640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0c81b0 con 0x7f599c0cc870 2024-04-14T10:58:12.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a233a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f599c168710 con 0x7f599c0c94a0 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a1338640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f599c0cc870 0x7f599c06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a1338640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f599c0cc870 0x7f599c06e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43194/0 (socket says 172.21.15.84:43194) 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a1338640 1 -- 172.21.15.84:0/3733308425 learned_addr learned my addr 172.21.15.84:0/3733308425 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.734+0000 7f59a1b39640 1 --2- 172.21.15.84:0/3733308425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0c94a0 0x7f599c164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.735+0000 7f59a1338640 1 -- 172.21.15.84:0/3733308425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0c94a0 msgr2=0x7f599c164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.735+0000 7f59a1338640 1 --2- 172.21.15.84:0/3733308425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0c94a0 0x7f599c164890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.735+0000 7f59a1338640 1 -- 172.21.15.84:0/3733308425 >> v1:172.21.15.175:6789/0 conn(0x7f599c0ccc50 legacy=0x7f599c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.735+0000 7f59a1338640 1 -- 172.21.15.84:0/3733308425 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c167de0 con 0x7f599c0cc870 2024-04-14T10:58:12.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7f59a1338640 1 --2- 172.21.15.84:0/3733308425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0cc870 0x7f599c06e5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5994009070 tx=0x7f5994034aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d309a0f2ee38b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7f5993fff640 1 -- 172.21.15.84:0/3733308425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994036650 con 0x7f599c0cc870 2024-04-14T10:58:12.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7ff2f1c98640 1 Processor -- start 2024-04-14T10:58:12.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7f752759e640 1 Processor -- start 2024-04-14T10:58:12.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7f752759e640 1 -- start start 2024-04-14T10:58:12.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7f5993fff640 1 -- 172.21.15.84:0/3733308425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59940367f0 con 0x7f599c0cc870 2024-04-14T10:58:12.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7f5993fff640 1 -- 172.21.15.84:0/3733308425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994036bc0 con 0x7f599c0cc870 2024-04-14T10:58:12.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7f59a233a640 1 -- 172.21.15.84:0/3733308425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0cc870 msgr2=0x7f599c06e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7f59a233a640 1 --2- 172.21.15.84:0/3733308425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0cc870 0x7f599c06e5b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5994009070 tx=0x7f5994034aa0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7f67fc2c8640 1 Processor -- start 2024-04-14T10:58:12.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.736+0000 7ff2f1c98640 1 -- start start 2024-04-14T10:58:12.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7ff2f1c98640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2ec1594f0 0x7ff2ec0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7ff2f1c98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec0c8580 0x7ff2ec15f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7ff2f1c98640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2ec0c82d0 con 0x7ff2ec15fd50 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7ff2f1c98640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff2ec0c7f80 con 0x7ff2ec1594f0 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7ff2f1c98640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec1598d0 con 0x7ff2ec0c8580 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eaffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec0c8580 0x7ff2ec15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eaffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec0c8580 0x7ff2ec15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39100/0 (socket says 172.21.15.84:39100) 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eaffd640 1 -- 172.21.15.84:0/4166359189 learned_addr learned my addr 172.21.15.84:0/4166359189 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eb7fe640 1 --2- 172.21.15.84:0/4166359189 >> v2:172.21.15.175:3300/0 conn(0x7ff2ec1594f0 0x7ff2ec0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f59a233a640 1 -- 172.21.15.84:0/3733308425 shutdown_connections 2024-04-14T10:58:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f59a233a640 1 --2- 172.21.15.84:0/3733308425 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0c94a0 0x7f599c164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f59a233a640 1 --2- 172.21.15.84:0/3733308425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0cc870 0x7f599c06e5b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f59a233a640 1 -- 172.21.15.84:0/3733308425 >> 172.21.15.84:0/3733308425 conn(0x7f599c06bd20 msgr2=0x7f599c06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f59a233a640 1 -- 172.21.15.84:0/3733308425 shutdown_connections 2024-04-14T10:58:12.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f59a233a640 1 -- 172.21.15.84:0/3733308425 wait complete. 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f752759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7528072b40 0x7f75280d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.737+0000 7f67fc2c8640 1 -- start start 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f67fc2c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f67f4159210 0x7f67f41630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f67fc2c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f406f8e0 0x7f67f406fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f67fc2c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f40630c0 con 0x7f67f41595f0 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f67fc2c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f67f4163630 con 0x7f67f4159210 2024-04-14T10:58:12.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f67fc2c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f67f40ca0a0 con 0x7f67f406f8e0 2024-04-14T10:58:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eb7fe640 1 -- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec0c8580 msgr2=0x7ff2ec15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eb7fe640 1 --2- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec0c8580 0x7ff2ec15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eb7fe640 1 -- 172.21.15.84:0/4166359189 >> v1:172.21.15.175:6789/0 conn(0x7ff2ec15fd50 legacy=0x7ff2ec0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7f752759e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75280d0cc0 0x7f75280cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.738+0000 7ff2eb7fe640 1 -- 172.21.15.84:0/4166359189 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec1635a0 con 0x7ff2ec1594f0 2024-04-14T10:58:12.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f752759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f752815f090 con 0x7f7528154eb0 2024-04-14T10:58:12.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f752759e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7528155290 con 0x7f75280d0cc0 2024-04-14T10:58:12.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f752759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f75280cbcd0 con 0x7f7528072b40 2024-04-14T10:58:12.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75280d0cc0 0x7f75280cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.745 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa865640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f406f8e0 0x7f67f406fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa865640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f406f8e0 0x7f67f406fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39126/0 (socket says 172.21.15.84:39126) 2024-04-14T10:58:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa865640 1 -- 172.21.15.84:0/2261778303 learned_addr learned my addr 172.21.15.84:0/2261778303 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa064640 1 --2- 172.21.15.84:0/2261778303 >> v2:172.21.15.84:3300/0 conn(0x7f67f4159210 0x7f67f41630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f75280d0cc0 0x7f75280cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43212/0 (socket says 172.21.15.84:43212) 2024-04-14T10:58:12.746 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 -- 172.21.15.84:0/3357260183 learned_addr learned my addr 172.21.15.84:0/3357260183 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f277359e640 1 Processor -- start 2024-04-14T10:58:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f277359e640 1 -- start start 2024-04-14T10:58:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 -- 172.21.15.84:0/3357260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7528072b40 msgr2=0x7f75280d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 --2- 172.21.15.84:0/3357260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7528072b40 0x7f75280d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 -- 172.21.15.84:0/3357260183 >> v1:172.21.15.175:6789/0 conn(0x7f7528154eb0 legacy=0x7f752815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f7526d9d640 1 -- 172.21.15.84:0/3357260183 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752815e510 con 0x7f75280d0cc0 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.740+0000 7ff2eb7fe640 1 --2- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec1594f0 0x7ff2ec0c7a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00097a0 tx=0x7ff2e002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c1648e725c0fee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.740+0000 7ff2ea7fc640 1 -- 172.21.15.84:0/4166359189 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0031780 con 0x7ff2ec1594f0 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.740+0000 7ff2ea7fc640 1 -- 172.21.15.84:0/4166359189 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e0037070 con 0x7ff2ec1594f0 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.740+0000 7ff2ea7fc640 1 -- 172.21.15.84:0/4166359189 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0031b40 con 0x7ff2ec1594f0 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa064640 1 -- 172.21.15.84:0/2261778303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f406f8e0 msgr2=0x7f67f406fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa064640 1 --2- 172.21.15.84:0/2261778303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f406f8e0 0x7f67f406fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa064640 1 -- 172.21.15.84:0/2261778303 >> v1:172.21.15.175:6789/0 conn(0x7f67f41595f0 legacy=0x7f67f40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.739+0000 7f67fa064640 1 -- 172.21.15.84:0/2261778303 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f40ca340 con 0x7f67f4159210 2024-04-14T10:58:12.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f59a233a640 1 Processor -- start 2024-04-14T10:58:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f59a233a640 1 -- start start 2024-04-14T10:58:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f277359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 0x7f276c0e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f7526d9d640 1 --2- 172.21.15.84:0/3357260183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75280d0cc0 0x7f75280cc1b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7520009e50 tx=0x7f752002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0019f501500ae71 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.750 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f67fa064640 1 --2- 172.21.15.84:0/2261778303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f4159210 0x7f67f41630f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009d90 tx=0x7f67ec02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec41d177793a7785 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f277359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c034d50 0x7f276c006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f277359e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f276c04b390 con 0x7f276c007bf0 2024-04-14T10:58:12.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f67f9062640 1 -- 172.21.15.84:0/2261778303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec039070 con 0x7f67f4159210 2024-04-14T10:58:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7ff2f1c98640 1 -- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec1594f0 msgr2=0x7ff2ec0c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec1594f0 0x7ff2ec0c7a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00097a0 tx=0x7ff2e002b820 comp rx=0 tx=0).stop 2024-04-14T10:58:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f277259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 0x7f276c0e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f277259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 0x7f276c0e0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43224/0 (socket says 172.21.15.84:43224) 2024-04-14T10:58:12.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f277259c640 1 -- 172.21.15.84:0/388858505 learned_addr learned my addr 172.21.15.84:0/388858505 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f67f9062640 1 -- 172.21.15.84:0/2261778303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67ec02ccf0 con 0x7f67f4159210 2024-04-14T10:58:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.741+0000 7f2771d9b640 1 --2- 172.21.15.84:0/388858505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c034d50 0x7f276c006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f276c007130 con 0x7f276c0d6db0 2024-04-14T10:58:12.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f67f9062640 1 -- 172.21.15.84:0/2261778303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec034660 con 0x7f67f4159210 2024-04-14T10:58:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f752559a640 1 -- 172.21.15.84:0/3357260183 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752002ca80 con 0x7f75280d0cc0 2024-04-14T10:58:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7ff2f1c98640 1 -- 172.21.15.84:0/4166359189 shutdown_connections 2024-04-14T10:58:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec0c8580 0x7ff2ec15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/4166359189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec1594f0 0x7ff2ec0c7a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.754 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7ff2f1c98640 1 -- 172.21.15.84:0/4166359189 >> 172.21.15.84:0/4166359189 conn(0x7ff2ec06b900 msgr2=0x7ff2ec06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f752559a640 1 -- 172.21.15.84:0/3357260183 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752002cc20 con 0x7f75280d0cc0 2024-04-14T10:58:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f752559a640 1 -- 172.21.15.84:0/3357260183 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75200343f0 con 0x7f75280d0cc0 2024-04-14T10:58:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7ff2f1c98640 1 -- 172.21.15.84:0/4166359189 shutdown_connections 2024-04-14T10:58:12.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f276c036750 con 0x7f276c034d50 2024-04-14T10:58:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a233a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 0x7f599c161310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a233a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0cc870 0x7f599c0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a233a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0ccc50 0x7f599c16a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f277159a640 1 -- 172.21.15.84:0/388858505 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98945043 0 0) 0x7f276c04b390 con 0x7f276c007bf0 2024-04-14T10:58:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a233a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f599c06eaf0 con 0x7f599c0ccc50 2024-04-14T10:58:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a233a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f599c1683a0 con 0x7f599c0c94a0 2024-04-14T10:58:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f277159a640 1 -- 172.21.15.84:0/388858505 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f275c003520 con 0x7f276c007bf0 2024-04-14T10:58:12.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a233a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f599c06ec70 con 0x7f599c0cc870 2024-04-14T10:58:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a1338640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 0x7f599c161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a1b39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0ccc50 0x7f599c16a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a1338640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 0x7f599c161310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:44776/0 (socket says 172.21.15.84:44776) 2024-04-14T10:58:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f59a1338640 1 -- 172.21.15.84:0/126145504 learned_addr learned my addr 172.21.15.84:0/126145504 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f277159a640 1 -- 172.21.15.84:0/388858505 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2751076811 0 0) 0x7f275c003520 con 0x7f276c007bf0 2024-04-14T10:58:12.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7ff2f1c98640 1 -- 172.21.15.84:0/4166359189 wait complete. 2024-04-14T10:58:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f67fc2c8640 1 -- 172.21.15.84:0/2261778303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f4159210 msgr2=0x7f67f41630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.742+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/2261778303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f4159210 0x7f67f41630f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009d90 tx=0x7f67ec02bf40 comp rx=0 tx=0).stop 2024-04-14T10:58:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f2771d9b640 1 -- 172.21.15.84:0/388858505 >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 msgr2=0x7f276c0e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f2771d9b640 1 --2- 172.21.15.84:0/388858505 >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 0x7f276c0e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f2771d9b640 1 -- 172.21.15.84:0/388858505 >> v1:172.21.15.175:6789/0 conn(0x7f276c007bf0 legacy=0x7f276c0341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f2771d9b640 1 -- 172.21.15.84:0/388858505 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c036a30 con 0x7f276c034d50 2024-04-14T10:58:12.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a0b37640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0cc870 0x7f599c0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 -- 172.21.15.84:0/3357260183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75280d0cc0 msgr2=0x7f75280cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 --2- 172.21.15.84:0/3357260183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75280d0cc0 0x7f75280cc1b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7520009e50 tx=0x7f752002bee0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 -- 172.21.15.84:0/3357260183 shutdown_connections 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 --2- 172.21.15.84:0/3357260183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f75280d0cc0 0x7f75280cc1b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 --2- 172.21.15.84:0/3357260183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7528072b40 0x7f75280d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 -- 172.21.15.84:0/3357260183 >> 172.21.15.84:0/3357260183 conn(0x7f75280734a0 msgr2=0x7f75280738b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a1b39640 1 -- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0cc870 msgr2=0x7f599c0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a1b39640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0cc870 0x7f599c0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a1b39640 1 -- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 msgr2=0x7f599c161310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a1b39640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 0x7f599c161310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a1b39640 1 -- 172.21.15.84:0/126145504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c16bc30 con 0x7f599c0ccc50 2024-04-14T10:58:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a0b37640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0cc870 0x7f599c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f59a1338640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 0x7f599c161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f277259c640 1 --2- 172.21.15.84:0/388858505 >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 0x7f276c0e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 -- 172.21.15.84:0/3357260183 shutdown_connections 2024-04-14T10:58:12.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f752759e640 1 -- 172.21.15.84:0/3357260183 wait complete. 2024-04-14T10:58:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f67fc2c8640 1 -- 172.21.15.84:0/2261778303 shutdown_connections 2024-04-14T10:58:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/2261778303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f406f8e0 0x7f67f406fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/2261778303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f4159210 0x7f67f41630f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.743+0000 7f67fc2c8640 1 -- 172.21.15.84:0/2261778303 >> 172.21.15.84:0/2261778303 conn(0x7f67f40cd420 msgr2=0x7f67f40c98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7ff2f1c98640 1 Processor -- start 2024-04-14T10:58:12.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f59a1b39640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0ccc50 0x7f599c16a7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d6f0 tx=0x7f598c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f2771d9b640 1 --2- 172.21.15.84:0/388858505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c034d50 0x7f276c006620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2774074900 tx=0x7f27740a7ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2207999bba00a7c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f67fc2c8640 1 -- 172.21.15.84:0/2261778303 shutdown_connections 2024-04-14T10:58:12.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f277159a640 1 -- 172.21.15.84:0/388858505 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768001670 con 0x7f276c034d50 2024-04-14T10:58:12.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f277159a640 1 -- 172.21.15.84:0/388858505 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27740ab710 con 0x7f276c034d50 2024-04-14T10:58:12.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f277159a640 1 -- 172.21.15.84:0/388858505 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740abb80 con 0x7f276c034d50 2024-04-14T10:58:12.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f67fc2c8640 1 -- 172.21.15.84:0/2261778303 wait complete. 2024-04-14T10:58:12.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c015070 con 0x7f599c0ccc50 2024-04-14T10:58:12.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c169500 con 0x7f599c0ccc50 2024-04-14T10:58:12.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c169ac0 con 0x7f599c0ccc50 2024-04-14T10:58:12.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c007900 con 0x7f599c0ccc50 2024-04-14T10:58:12.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c007cd0 con 0x7f599c0ccc50 2024-04-14T10:58:12.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.744+0000 7ff2f1c98640 1 -- start start 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7f752759e640 1 Processor -- start 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7f752759e640 1 -- start start 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.745+0000 7ff2f1c98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ec0c8580 0x7ff2ec1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7ff2f1c98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec1594f0 0x7ff2ec15e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7ff2f1c98640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec15fd50 0x7ff2ec15e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7ff2f1c98640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec162fe0 con 0x7ff2ec0c8580 2024-04-14T10:58:12.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7ff2f1c98640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec162d00 con 0x7ff2ec15fd50 2024-04-14T10:58:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c034d50 msgr2=0x7f276c006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7f277359e640 1 --2- 172.21.15.84:0/388858505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c034d50 0x7f276c006620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2774074900 tx=0x7f27740a7ab0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7ff2f1c98640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2ec1632c0 con 0x7ff2ec1594f0 2024-04-14T10:58:12.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.746+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f597c005290 con 0x7f599c0ccc50 2024-04-14T10:58:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2eb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ec0c8580 0x7ff2ec1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2eb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ec0c8580 0x7ff2ec1602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43240/0 (socket says 172.21.15.84:43240) 2024-04-14T10:58:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2eb7fe640 1 -- 172.21.15.84:0/2352235652 learned_addr learned my addr 172.21.15.84:0/2352235652 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2ebfff640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec15fd50 0x7ff2ec15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2eaffd640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec1594f0 0x7ff2ec15e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f598c018070 con 0x7f599c0ccc50 2024-04-14T10:58:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f67fc2c8640 1 Processor -- start 2024-04-14T10:58:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 shutdown_connections 2024-04-14T10:58:12.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f277359e640 1 --2- 172.21.15.84:0/388858505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c034d50 0x7f276c006620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f277359e640 1 --2- 172.21.15.84:0/388858505 >> v2:172.21.15.84:3300/0 conn(0x7f276c0d6db0 0x7f276c0e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 >> 172.21.15.84:0/388858505 conn(0x7f276c050a10 msgr2=0x7f276c050e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2ebfff640 1 -- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec1594f0 msgr2=0x7ff2ec15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2ebfff640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec1594f0 0x7ff2ec15e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2ebfff640 1 -- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ec0c8580 msgr2=0x7ff2ec1602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2ebfff640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ec0c8580 0x7ff2ec1602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f752759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7528072b40 0x7f75281f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7ff2ebfff640 1 -- 172.21.15.84:0/2352235652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec146120 con 0x7ff2ec15fd50 2024-04-14T10:58:12.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.747+0000 7f67fc2c8640 1 -- start start 2024-04-14T10:58:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f752759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 0x7f75280b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f752759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528154eb0 0x7f752815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 shutdown_connections 2024-04-14T10:58:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f752759e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f752815edb0 con 0x7f7528072b40 2024-04-14T10:58:12.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f7525d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 0x7f75280b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f277359e640 1 -- 172.21.15.84:0/388858505 wait complete. 2024-04-14T10:58:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f7525d9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 0x7f75280b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39154/0 (socket says 172.21.15.84:39154) 2024-04-14T10:58:12.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f7525d9b640 1 -- 172.21.15.84:0/3773258843 learned_addr learned my addr 172.21.15.84:0/3773258843 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fc2c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67f406f8e0 0x7f67f406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fc2c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f4159210 0x7f67f41f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fc2c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 0x7f67f41f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fc2c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f67f40c7ad0 con 0x7f67f415b460 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fc2c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f67f40c77f0 con 0x7f67f406f8e0 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fc2c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f67f40c7db0 con 0x7f67f4159210 2024-04-14T10:58:12.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f7526d9d640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528154eb0 0x7f752815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fa865640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 0x7f67f41f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67f9863640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f4159210 0x7f67f41f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fa865640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 0x7f67f41f5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43270/0 (socket says 172.21.15.84:43270) 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67f9863640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f4159210 0x7f67f41f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39164/0 (socket says 172.21.15.84:39164) 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f67fa865640 1 -- 172.21.15.84:0/1848639492 learned_addr learned my addr 172.21.15.84:0/1848639492 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7f5991ffb640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f598006c9c0 0x7f598006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f752659c640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7528072b40 0x7f75281f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.748+0000 7ff2ebfff640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec15fd50 0x7ff2ec15e910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400be00 tx=0x7ff2e400bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f752815ead0 con 0x7f7528154eb0 2024-04-14T10:58:12.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f598c08bc10 con 0x7f599c0ccc50 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa064640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67f406f8e0 0x7f67f406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa865640 1 -- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f4159210 msgr2=0x7f67f41f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa865640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f4159210 0x7f67f41f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa865640 1 -- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67f406f8e0 msgr2=0x7f67f406e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa865640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67f406f8e0 0x7f67f406e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa865640 1 -- 172.21.15.84:0/1848639492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f41f7ff0 con 0x7f67f415b460 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f67fa865640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 0x7f67f41f5290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67f000e8a0 tx=0x7f67f000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f59a1338640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f598006c9c0 0x7f598006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f752815e130 con 0x7f75280d0cc0 2024-04-14T10:58:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4003970 con 0x7ff2ec15fd50 2024-04-14T10:58:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e4003b10 con 0x7ff2ec15fd50 2024-04-14T10:58:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004020 con 0x7ff2ec15fd50 2024-04-14T10:58:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec15a1c0 con 0x7ff2ec15fd50 2024-04-14T10:58:12.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.749+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec145360 con 0x7ff2ec15fd50 2024-04-14T10:58:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f7525d9b640 1 -- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528154eb0 msgr2=0x7f752815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f7525d9b640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528154eb0 0x7f752815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f7525d9b640 1 -- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7528072b40 msgr2=0x7f75281f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f7525d9b640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7528072b40 0x7f75281f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f7525d9b640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75281f07c0 con 0x7f75280d0cc0 2024-04-14T10:58:12.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f59a1338640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f598006c9c0 0x7f598006ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5994034ae0 tx=0x7f599403a000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f277359e640 1 Processor -- start 2024-04-14T10:58:12.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f277359e640 1 -- start start 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.750+0000 7f752659c640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7528072b40 0x7f75281f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f7525d9b640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 0x7f75280b4560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f751800b4d0 tx=0x7f751800b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518014070 con 0x7f75280d0cc0 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7518010870 con 0x7f75280d0cc0 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518010c60 con 0x7f75280d0cc0 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75281540a0 con 0x7f75280d0cc0 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.751+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75281f0d20 con 0x7f75280d0cc0 2024-04-14T10:58:12.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f277359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f276c007bf0 0x7f276c04f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f277359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 0x7f276c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2e40041c0 con 0x7ff2ec15fd50 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2cc005290 con 0x7ff2ec15fd50 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f2771d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 0x7f276c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f2771d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 0x7f276c0c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43276/0 (socket says 172.21.15.84:43276) 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f277259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f276c007bf0 0x7f276c04f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f277259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f276c007bf0 0x7f276c04f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:44822/0 (socket says 172.21.15.84:44822) 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f2771d9b640 1 -- 172.21.15.84:0/832239503 learned_addr learned my addr 172.21.15.84:0/832239503 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c0d6db0 0x7f276c0c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.752+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0d7190 con 0x7f276c034d50 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f276c0076d0 con 0x7f276c007bf0 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f276c0c9060 con 0x7f276c0d6db0 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f2772d9d640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c0d6db0 0x7f276c0c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7ff2d3fff640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d806c9f0 0x7ff2d806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7ff2eb7fe640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d806c9f0 0x7ff2d806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f2771d9b640 1 -- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c0d6db0 msgr2=0x7f276c0c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f2771d9b640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c0d6db0 0x7f276c0c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f2771d9b640 1 -- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f276c007bf0 msgr2=0x7f276c04f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f2771d9b640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f276c007bf0 0x7f276c04f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.753+0000 7f2771d9b640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c0cd710 con 0x7f276c034d50 2024-04-14T10:58:12.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff2e408bbb0 con 0x7ff2ec15fd50 2024-04-14T10:58:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f2771d9b640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 0x7f276c0c85e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2774076b20 tx=0x7f27740637c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f2772d9d640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c0d6db0 0x7f276c0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:12.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7ff2eb7fe640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d806c9f0 0x7ff2d806eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2e002b860 tx=0x7ff2e003d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7518017070 con 0x7f75280d0cc0 2024-04-14T10:58:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f7516ffd640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f750806c9c0 0x7f750806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f751808b8e0 con 0x7f75280d0cc0 2024-04-14T10:58:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f752659c640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f750806c9c0 0x7f750806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7528068b70 con 0x7f75280d0cc0 2024-04-14T10:58:12.787 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f598c05a020 con 0x7f599c0ccc50 2024-04-14T10:58:12.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740c0070 con 0x7f276c034d50 2024-04-14T10:58:12.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27740a9d30 con 0x7f276c034d50 2024-04-14T10:58:12.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740b3600 con 0x7f276c034d50 2024-04-14T10:58:12.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f276c04ea60 con 0x7f276c034d50 2024-04-14T10:58:12.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f752659c640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f750806c9c0 0x7f750806ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f751c00a880 tx=0x7f751c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.754+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0017070 con 0x7f67f415b460 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f000c940 con 0x7f67f415b460 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f000cd30 con 0x7f67f415b460 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f41f82b0 con 0x7f67f415b460 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.755+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f41f8870 con 0x7f67f415b460 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.756+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f276c04f020 con 0x7f276c034d50 2024-04-14T10:58:12.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.756+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc005290 con 0x7f67f415b460 2024-04-14T10:58:12.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.757+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27740c3070 con 0x7f276c034d50 2024-04-14T10:58:12.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.757+0000 7f2762ffd640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f275406c9c0 0x7f275406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.758+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f276c0057e0 con 0x7f276c034d50 2024-04-14T10:58:12.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.758+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f67f001a070 con 0x7f67f415b460 2024-04-14T10:58:12.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.758+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff2e40598e0 con 0x7ff2ec15fd50 2024-04-14T10:58:12.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.758+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f27741298e0 con 0x7f276c034d50 2024-04-14T10:58:12.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.758+0000 7f277259c640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f275406c9c0 0x7f275406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.758+0000 7f67eaffd640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f67d806c940 0x7f67d806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:12.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.759+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f67f008c140 con 0x7f67f415b460 2024-04-14T10:58:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.759+0000 7f277259c640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f275406c9c0 0x7f275406ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2764009b40 tx=0x7f2764008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.759+0000 7f67fa064640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f67d806c940 0x7f67d806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.760+0000 7f67fa064640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f67d806c940 0x7f67d806ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67ec036000 tx=0x7f67ec030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:12.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.760+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f75281f07c0 con 0x7f75280d0cc0 2024-04-14T10:58:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.767+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f67f005a000 con 0x7f67f415b460 2024-04-14T10:58:12.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:12.776+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f27740b9040 con 0x7f276c034d50 2024-04-14T10:58:13.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.109+0000 7fc2a57fa640 1 -- 172.21.15.84:0/1418898677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc2b8168f30 con 0x7fc2b80e0490 2024-04-14T10:58:13.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.110+0000 7fc2a77fe640 1 -- 172.21.15.84:0/1418898677 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2b405d680 con 0x7fc2b80e0490 2024-04-14T10:58:13.109 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2024-04-14T10:58:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.113+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc2a806cb30 msgr2=0x7fc2a806eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.113+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc2a806cb30 0x7fc2a806eff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00096c0 tx=0x7fc2b0006bb0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.113+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80e0490 msgr2=0x7fc2b8169710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80e0490 0x7fc2b8169710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400e5f0 tx=0x7fc2b400eab0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 shutdown_connections 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc2a806cb30 0x7fc2a806eff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80e0490 0x7fc2b8169710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2b80d9250 0x7fc2b81691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 --2- 172.21.15.84:0/1418898677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b804ffd0 0x7fc2b804cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 >> 172.21.15.84:0/1418898677 conn(0x7fc2b800e160 msgr2=0x7fc2b80d7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 shutdown_connections 2024-04-14T10:58:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.114+0000 7fc2c50c8640 1 -- 172.21.15.84:0/1418898677 wait complete. 2024-04-14T10:58:13.127 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.128+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2c3404e450 con 0x7f2c34047270 2024-04-14T10:58:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.128+0000 7f2c32ffd640 1 -- 172.21.15.84:0/2308762560 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c38058d30 con 0x7f2c34047270 2024-04-14T10:58:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.131+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feaf8005580 con 0x7feb1406c170 2024-04-14T10:58:13.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-14T10:58:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.131+0000 7feb10ff9640 1 -- 172.21.15.84:0/3460274246 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb0c059820 con 0x7feb1406c170 2024-04-14T10:58:13.131 INFO:teuthology.orchestra.run.smithi084.stdout:55834574856 2024-04-14T10:58:13.131 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.131+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2c2006ca20 msgr2=0x7f2c2006eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.131+0000 7f2c431ad640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2c2006ca20 0x7f2c2006eee0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2c34005d40 tx=0x7f2c2c008040 comp rx=0 tx=0).stop 2024-04-14T10:58:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 msgr2=0x7f2c340d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 0x7f2c340d11b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800c7b0 tx=0x7f2c3800cc70 comp rx=0 tx=0).stop 2024-04-14T10:58:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 shutdown_connections 2024-04-14T10:58:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2c2006ca20 0x7f2c2006eee0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c340e0d30 0x7f2c3417caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c340d6ca0 0x7f2c3417c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 --2- 172.21.15.84:0/2308762560 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c34047270 0x7f2c340d11b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 >> 172.21.15.84:0/2308762560 conn(0x7f2c3400e0c0 msgr2=0x7f2c34052cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 shutdown_connections 2024-04-14T10:58:13.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.132+0000 7f2c431ad640 1 -- 172.21.15.84:0/2308762560 wait complete. 2024-04-14T10:58:13.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7feaf406c9f0 msgr2=0x7feaf406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7feaf406c9f0 0x7feaf406eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feb04036000 tx=0x7feb04008030 comp rx=0 tx=0).stop 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 msgr2=0x7feb141f32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 0x7feb141f32d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009fd0 tx=0x7feb0c00d4a0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 shutdown_connections 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7feaf406c9f0 0x7feaf406eeb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb140ca850 0x7feb14151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.134+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb140ca470 0x7feb141531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.135+0000 7feb1a7a5640 1 --2- 172.21.15.84:0/3460274246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feb1406c170 0x7feb141f32d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.135+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 >> 172.21.15.84:0/3460274246 conn(0x7feb14070750 msgr2=0x7feb1414fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.135+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 shutdown_connections 2024-04-14T10:58:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.135+0000 7feb1a7a5640 1 -- 172.21.15.84:0/3460274246 wait complete. 2024-04-14T10:58:13.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-14T10:58:13.150 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2024-04-14T10:58:13.151 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.159+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f276c006ce0 con 0x7f276c034d50 2024-04-14T10:58:13.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.159+0000 7f2762ffd640 1 -- 172.21.15.84:0/832239503 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f27740af030 con 0x7f276c034d50 2024-04-14T10:58:13.158 INFO:teuthology.orchestra.run.smithi084.stdout:55834574854 2024-04-14T10:58:13.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f275406c9c0 msgr2=0x7f275406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f275406c9c0 0x7f275406ee80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2764009b40 tx=0x7f2764008040 comp rx=0 tx=0).stop 2024-04-14T10:58:13.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 msgr2=0x7f276c0c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 0x7f276c0c85e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2774076b20 tx=0x7f27740637c0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 shutdown_connections 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f275406c9c0 0x7f275406ee80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f276c0d6db0 0x7f276c0c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f276c034d50 0x7f276c0c85e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 --2- 172.21.15.84:0/832239503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f276c007bf0 0x7f276c04f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 >> 172.21.15.84:0/832239503 conn(0x7f276c050a10 msgr2=0x7f276c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.161+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 shutdown_connections 2024-04-14T10:58:13.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.162+0000 7f277359e640 1 -- 172.21.15.84:0/832239503 wait complete. 2024-04-14T10:58:13.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.171+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff2cc005580 con 0x7ff2ec15fd50 2024-04-14T10:58:13.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.171+0000 7ff2d3fff640 1 -- 172.21.15.84:0/2352235652 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2e405dbe0 con 0x7ff2ec15fd50 2024-04-14T10:58:13.170 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:13.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-14T10:58:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.172+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f597c005580 con 0x7f599c0ccc50 2024-04-14T10:58:13.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7f5991ffb640 1 -- 172.21.15.84:0/126145504 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f598c059920 con 0x7f599c0ccc50 2024-04-14T10:58:13.172 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.172 INFO:teuthology.orchestra.run.smithi084.stdout:55834574853 2024-04-14T10:58:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d806c9f0 msgr2=0x7ff2d806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d806c9f0 0x7ff2d806eeb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2e002b860 tx=0x7ff2e003d040 comp rx=0 tx=0).stop 2024-04-14T10:58:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec15fd50 msgr2=0x7ff2ec15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec15fd50 0x7ff2ec15e910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400be00 tx=0x7ff2e400bef0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 shutdown_connections 2024-04-14T10:58:13.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d806c9f0 0x7ff2d806eeb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2ec15fd50 0x7ff2ec15e910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2ec1594f0 0x7ff2ec15e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 --2- 172.21.15.84:0/2352235652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2ec0c8580 0x7ff2ec1602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 >> 172.21.15.84:0/2352235652 conn(0x7ff2ec06b900 msgr2=0x7ff2ec0c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 shutdown_connections 2024-04-14T10:58:13.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.173+0000 7ff2f1c98640 1 -- 172.21.15.84:0/2352235652 wait complete. 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f598006c9c0 msgr2=0x7f598006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f598006c9c0 0x7f598006ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5994034ae0 tx=0x7f599403a000 comp rx=0 tx=0).stop 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0ccc50 msgr2=0x7f599c16a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0ccc50 0x7f599c16a7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d6f0 tx=0x7f598c00dbb0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 shutdown_connections 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f598006c9c0 0x7f598006ee80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f599c0ccc50 0x7f599c16a7f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f599c0cc870 0x7f599c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 --2- 172.21.15.84:0/126145504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f599c0c94a0 0x7f599c161310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 >> 172.21.15.84:0/126145504 conn(0x7f599c06bd20 msgr2=0x7f599c1663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 shutdown_connections 2024-04-14T10:58:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.176+0000 7f59a233a640 1 -- 172.21.15.84:0/126145504 wait complete. 2024-04-14T10:58:13.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.178+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f75280cb370 con 0x7f75280d0cc0 2024-04-14T10:58:13.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.178+0000 7f7516ffd640 1 -- 172.21.15.84:0/3773258843 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7518059610 con 0x7f75280d0cc0 2024-04-14T10:58:13.177 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f750806c9c0 msgr2=0x7f750806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f750806c9c0 0x7f750806ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f751c00a880 tx=0x7f751c008040 comp rx=0 tx=0).stop 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 msgr2=0x7f75280b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 0x7f75280b4560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f751800b4d0 tx=0x7f751800b990 comp rx=0 tx=0).stop 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 shutdown_connections 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f750806c9c0 0x7f750806ee80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7528154eb0 0x7f752815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75280d0cc0 0x7f75280b4560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 --2- 172.21.15.84:0/3773258843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7528072b40 0x7f75281f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 >> 172.21.15.84:0/3773258843 conn(0x7f75280734a0 msgr2=0x7f75280cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 shutdown_connections 2024-04-14T10:58:13.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.180+0000 7f752759e640 1 -- 172.21.15.84:0/3773258843 wait complete. 2024-04-14T10:58:13.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.183+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f67dc005850 con 0x7f67f415b460 2024-04-14T10:58:13.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.184+0000 7f67eaffd640 1 -- 172.21.15.84:0/1848639492 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67f005e300 con 0x7f67f415b460 2024-04-14T10:58:13.182 INFO:teuthology.orchestra.run.smithi084.stdout:55834574855 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f67d806c940 msgr2=0x7f67d806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f67d806c940 0x7f67d806ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67ec036000 tx=0x7f67ec030000 comp rx=0 tx=0).stop 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 msgr2=0x7f67f41f5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 0x7f67f41f5290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67f000e8a0 tx=0x7f67f000ed60 comp rx=0 tx=0).stop 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 shutdown_connections 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f67d806c940 0x7f67d806ee00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f67f415b460 0x7f67f41f5290 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f67f4159210 0x7f67f41f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 --2- 172.21.15.84:0/1848639492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67f406f8e0 0x7f67f406e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 >> 172.21.15.84:0/1848639492 conn(0x7f67f40cd420 msgr2=0x7f67f40cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 shutdown_connections 2024-04-14T10:58:13.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.187+0000 7f67fc2c8640 1 -- 172.21.15.84:0/1848639492 wait complete. 2024-04-14T10:58:13.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-14T10:58:13.189 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-14T10:58:13.189 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-14T10:58:13.192 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-14T10:58:13.197 DEBUG:teuthology.parallel:result is None 2024-04-14T10:58:13.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T10:58:13.198 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.338+0000 7f99a0076640 1 Processor -- start 2024-04-14T10:58:13.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.338+0000 7f99a0076640 1 -- start start 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f99a0076640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f999815cdf0 0x7f99980ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f99a0076640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9998070200 con 0x7f99981551d0 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f99a0076640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999815acd0 con 0x7f99980ce320 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f99a0076640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f999815af70 con 0x7f999815cdf0 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999de12640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f99981551d0 0x7f999806faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48034/0 (socket says 172.21.15.84:48034) 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999de12640 1 -- 172.21.15.84:0/1244179732 learned_addr learned my addr 172.21.15.84:0/1244179732 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999e613640 1 --2- 172.21.15.84:0/1244179732 >> v2:172.21.15.84:3300/0 conn(0x7f999815cdf0 0x7f99980ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999e613640 1 -- 172.21.15.84:0/1244179732 >> v1:172.21.15.175:6789/0 conn(0x7f99980ce320 legacy=0x7f999815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999e613640 1 -- 172.21.15.84:0/1244179732 >> v1:172.21.15.84:6789/0 conn(0x7f99981551d0 legacy=0x7f999806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999e613640 1 -- 172.21.15.84:0/1244179732 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999815b210 con 0x7f999815cdf0 2024-04-14T10:58:13.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.339+0000 7f999ce10640 1 -- 172.21.15.84:0/1244179732 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090176270 0 0) 0x7f9998070200 con 0x7f99981551d0 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f999e613640 1 --2- 172.21.15.84:0/1244179732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999815cdf0 0x7f99980ce750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9990009d90 tx=0x7f999002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d079d8a01d15e495 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f999ce10640 1 -- 172.21.15.84:0/1244179732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990039070 con 0x7f999815cdf0 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f999ce10640 1 -- 172.21.15.84:0/1244179732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999002cd00 con 0x7f999815cdf0 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f999ce10640 1 -- 172.21.15.84:0/1244179732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990034660 con 0x7f999815cdf0 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f99a0076640 1 -- 172.21.15.84:0/1244179732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999815cdf0 msgr2=0x7f99980ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f99a0076640 1 --2- 172.21.15.84:0/1244179732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999815cdf0 0x7f99980ce750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9990009d90 tx=0x7f999002bf50 comp rx=0 tx=0).stop 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f99a0076640 1 -- 172.21.15.84:0/1244179732 shutdown_connections 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f99a0076640 1 --2- 172.21.15.84:0/1244179732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f999815cdf0 0x7f99980ce750 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.340+0000 7f99a0076640 1 -- 172.21.15.84:0/1244179732 >> 172.21.15.84:0/1244179732 conn(0x7f999806db10 msgr2=0x7f999806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.341+0000 7f99a0076640 1 -- 172.21.15.84:0/1244179732 shutdown_connections 2024-04-14T10:58:13.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.341+0000 7f99a0076640 1 -- 172.21.15.84:0/1244179732 wait complete. 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 Processor -- start 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 -- start start 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 0x7f9998152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99981551d0 0x7f99981e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999815cdf0 0x7f99981e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f999815bab0 con 0x7f99980ce320 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f999815b7d0 con 0x7f999815cdf0 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f99a0076640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f999815c1c0 con 0x7f99981551d0 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f999de12640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 0x7f9998152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f999de12640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 0x7f9998152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43290/0 (socket says 172.21.15.84:43290) 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.342+0000 7f999de12640 1 -- 172.21.15.84:0/999116028 learned_addr learned my addr 172.21.15.84:0/999116028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:13.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999e613640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999815cdf0 0x7f99981e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999d611640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99981551d0 0x7f99981e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999de12640 1 -- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99981551d0 msgr2=0x7f99981e4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999de12640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99981551d0 0x7f99981e4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999de12640 1 -- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999815cdf0 msgr2=0x7f99981e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999de12640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999815cdf0 0x7f99981e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999de12640 1 -- 172.21.15.84:0/999116028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99981f0b20 con 0x7f99980ce320 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f999de12640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 0x7f9998152160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f999400c4d0 tx=0x7f999400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994018070 con 0x7f99980ce320 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9994007500 con 0x7f99980ce320 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99981f0de0 con 0x7f99980ce320 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994004a20 con 0x7f99980ce320 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.343+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99981f13a0 con 0x7f99980ce320 2024-04-14T10:58:13.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.344+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9998069c30 con 0x7f99980ce320 2024-04-14T10:58:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.344+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f999401b070 con 0x7f99980ce320 2024-04-14T10:58:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.345+0000 7f998e7fc640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f997c06c920 0x7f997c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.345+0000 7f999d611640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f997c06c920 0x7f997c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.345+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f999408add0 con 0x7f99980ce320 2024-04-14T10:58:13.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.345+0000 7f999d611640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f997c06c920 0x7f997c06ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:13.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.349+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f9994059290 con 0x7f99980ce320 2024-04-14T10:58:13.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.524+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99981541c0 con 0x7f997c06c920 2024-04-14T10:58:13.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.530+0000 7f998e7fc640 1 -- 172.21.15.84:0/999116028 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f99981541c0 con 0x7f997c06c920 2024-04-14T10:58:13.532 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:13.533 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:13.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f997c06c920 msgr2=0x7f997c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f997c06c920 0x7f997c06ede0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9988006fd0 tx=0x7f9988008040 comp rx=0 tx=0).stop 2024-04-14T10:58:13.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 msgr2=0x7f9998152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 0x7f9998152160 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f999400c4d0 tx=0x7f999400c990 comp rx=0 tx=0).stop 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 shutdown_connections 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f997c06c920 0x7f997c06ede0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f999815cdf0 0x7f99981e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99981551d0 0x7f99981e4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 --2- 172.21.15.84:0/999116028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f99980ce320 0x7f9998152160 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 >> 172.21.15.84:0/999116028 conn(0x7f999806db10 msgr2=0x7f9998158880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 shutdown_connections 2024-04-14T10:58:13.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.533+0000 7f99a0076640 1 -- 172.21.15.84:0/999116028 wait complete. 2024-04-14T10:58:13.542 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-14T10:58:13.403582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.214714"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.421646+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:06.421646+0000","last_peered":"2024-04-14T10:58:06.421646+0000","last_clean":"2024-04-14T10:58:06.421646+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:06.421646+0000","last_undegraded":"2024-04-14T10:58:06.421646+0000","last_fullsized":"2024-04-14T10:58:06.421646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.416971+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:06.416971+0000","last_peered":"2024-04-14T10:58:06.416971+0000","last_clean":"2024-04-14T10:58:06.416971+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:06.416971+0000","last_undegraded":"2024-04-14T10:58:06.416971+0000","last_fullsized":"2024-04-14T10:58:06.416971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571212+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:05.571212+0000","last_peered":"2024-04-14T10:58:05.571212+0000","last_clean":"2024-04-14T10:58:05.571212+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:05.571212+0000","last_undegraded":"2024-04-14T10:58:05.571212+0000","last_fullsized":"2024-04-14T10:58:05.571212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202831+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:05.202831+0000","last_peered":"2024-04-14T10:58:05.202831+0000","last_clean":"2024-04-14T10:58:05.202831+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:05.202831+0000","last_undegraded":"2024-04-14T10:58:05.202831+0000","last_fullsized":"2024-04-14T10:58:05.202831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571625+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:05.571625+0000","last_peered":"2024-04-14T10:58:05.571625+0000","last_clean":"2024-04-14T10:58:05.571625+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:05.571625+0000","last_undegraded":"2024-04-14T10:58:05.571625+0000","last_fullsized":"2024-04-14T10:58:05.571625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202909+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:05.202909+0000","last_peered":"2024-04-14T10:58:05.202909+0000","last_clean":"2024-04-14T10:58:05.202909+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:05.202909+0000","last_undegraded":"2024-04-14T10:58:05.202909+0000","last_fullsized":"2024-04-14T10:58:05.202909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208453+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:09.208453+0000","last_peered":"2024-04-14T10:58:09.208453+0000","last_clean":"2024-04-14T10:58:09.208453+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:09.208453+0000","last_undegraded":"2024-04-14T10:58:09.208453+0000","last_fullsized":"2024-04-14T10:58:09.208453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208083+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:09.208083+0000","last_peered":"2024-04-14T10:58:09.208083+0000","last_clean":"2024-04-14T10:58:09.208083+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:09.208083+0000","last_undegraded":"2024-04-14T10:58:09.208083+0000","last_fullsized":"2024-04-14T10:58:09.208083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.205569+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:09.205569+0000","last_peered":"2024-04-14T10:58:09.205569+0000","last_clean":"2024-04-14T10:58:09.205569+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:09.205569+0000","last_undegraded":"2024-04-14T10:58:09.205569+0000","last_fullsized":"2024-04-14T10:58:09.205569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203292+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:05.203292+0000","last_peered":"2024-04-14T10:58:05.203292+0000","last_clean":"2024-04-14T10:58:05.203292+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:05.203292+0000","last_undegraded":"2024-04-14T10:58:05.203292+0000","last_fullsized":"2024-04-14T10:58:05.203292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571308+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:05.571308+0000","last_peered":"2024-04-14T10:58:05.571308+0000","last_clean":"2024-04-14T10:58:05.571308+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:05.571308+0000","last_undegraded":"2024-04-14T10:58:05.571308+0000","last_fullsized":"2024-04-14T10:58:05.571308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.205298+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:09.205298+0000","last_peered":"2024-04-14T10:58:09.205298+0000","last_clean":"2024-04-14T10:58:09.205298+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:09.205298+0000","last_undegraded":"2024-04-14T10:58:09.205298+0000","last_fullsized":"2024-04-14T10:58:09.205298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417439+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:06.417439+0000","last_peered":"2024-04-14T10:58:06.417439+0000","last_clean":"2024-04-14T10:58:06.417439+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:06.417439+0000","last_undegraded":"2024-04-14T10:58:06.417439+0000","last_fullsized":"2024-04-14T10:58:06.417439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203250+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:09.203250+0000","last_peered":"2024-04-14T10:58:09.203250+0000","last_clean":"2024-04-14T10:58:09.203250+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:09.203250+0000","last_undegraded":"2024-04-14T10:58:09.203250+0000","last_fullsized":"2024-04-14T10:58:09.203250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422915+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:06.422915+0000","last_peered":"2024-04-14T10:58:06.422915+0000","last_clean":"2024-04-14T10:58:06.422915+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:06.422915+0000","last_undegraded":"2024-04-14T10:58:06.422915+0000","last_fullsized":"2024-04-14T10:58:06.422915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571568+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:05.571568+0000","last_peered":"2024-04-14T10:58:05.571568+0000","last_clean":"2024-04-14T10:58:05.571568+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:05.571568+0000","last_undegraded":"2024-04-14T10:58:05.571568+0000","last_fullsized":"2024-04-14T10:58:05.571568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202728+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:05.202728+0000","last_peered":"2024-04-14T10:58:05.202728+0000","last_clean":"2024-04-14T10:58:05.202728+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:05.202728+0000","last_undegraded":"2024-04-14T10:58:05.202728+0000","last_fullsized":"2024-04-14T10:58:05.202728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571456+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:05.571456+0000","last_peered":"2024-04-14T10:58:05.571456+0000","last_clean":"2024-04-14T10:58:05.571456+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:05.571456+0000","last_undegraded":"2024-04-14T10:58:05.571456+0000","last_fullsized":"2024-04-14T10:58:05.571456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571147+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:05.571147+0000","last_peered":"2024-04-14T10:58:05.571147+0000","last_clean":"2024-04-14T10:58:05.571147+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:05.571147+0000","last_undegraded":"2024-04-14T10:58:05.571147+0000","last_fullsized":"2024-04-14T10:58:05.571147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203427+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:05.203427+0000","last_peered":"2024-04-14T10:58:05.203427+0000","last_clean":"2024-04-14T10:58:05.203427+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:05.203427+0000","last_undegraded":"2024-04-14T10:58:05.203427+0000","last_fullsized":"2024-04-14T10:58:05.203427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572451+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:05.572451+0000","last_peered":"2024-04-14T10:58:05.572451+0000","last_clean":"2024-04-14T10:58:05.572451+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:05.572451+0000","last_undegraded":"2024-04-14T10:58:05.572451+0000","last_fullsized":"2024-04-14T10:58:05.572451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197652+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:05.197652+0000","last_peered":"2024-04-14T10:58:05.197652+0000","last_clean":"2024-04-14T10:58:05.197652+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:05.197652+0000","last_undegraded":"2024-04-14T10:58:05.197652+0000","last_fullsized":"2024-04-14T10:58:05.197652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.202682+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:09.202682+0000","last_peered":"2024-04-14T10:58:09.202682+0000","last_clean":"2024-04-14T10:58:09.202682+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:09.202682+0000","last_undegraded":"2024-04-14T10:58:09.202682+0000","last_fullsized":"2024-04-14T10:58:09.202682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571306+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:05.571306+0000","last_peered":"2024-04-14T10:58:05.571306+0000","last_clean":"2024-04-14T10:58:05.571306+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:05.571306+0000","last_undegraded":"2024-04-14T10:58:05.571306+0000","last_fullsized":"2024-04-14T10:58:05.571306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197542+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:05.197542+0000","last_peered":"2024-04-14T10:58:05.197542+0000","last_clean":"2024-04-14T10:58:05.197542+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:05.197542+0000","last_undegraded":"2024-04-14T10:58:05.197542+0000","last_fullsized":"2024-04-14T10:58:05.197542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197582+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:05.197582+0000","last_peered":"2024-04-14T10:58:05.197582+0000","last_clean":"2024-04-14T10:58:05.197582+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:05.197582+0000","last_undegraded":"2024-04-14T10:58:05.197582+0000","last_fullsized":"2024-04-14T10:58:05.197582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208078+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:09.208078+0000","last_peered":"2024-04-14T10:58:09.208078+0000","last_clean":"2024-04-14T10:58:09.208078+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:09.208078+0000","last_undegraded":"2024-04-14T10:58:09.208078+0000","last_fullsized":"2024-04-14T10:58:09.208078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208343+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:09.208343+0000","last_peered":"2024-04-14T10:58:09.208343+0000","last_clean":"2024-04-14T10:58:09.208343+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:09.208343+0000","last_undegraded":"2024-04-14T10:58:09.208343+0000","last_fullsized":"2024-04-14T10:58:09.208343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208092+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:09.208092+0000","last_peered":"2024-04-14T10:58:09.208092+0000","last_clean":"2024-04-14T10:58:09.208092+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:09.208092+0000","last_undegraded":"2024-04-14T10:58:09.208092+0000","last_fullsized":"2024-04-14T10:58:09.208092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.421668+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:06.421668+0000","last_peered":"2024-04-14T10:58:06.421668+0000","last_clean":"2024-04-14T10:58:06.421668+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:06.421668+0000","last_undegraded":"2024-04-14T10:58:06.421668+0000","last_fullsized":"2024-04-14T10:58:06.421668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208574+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:09.208574+0000","last_peered":"2024-04-14T10:58:09.208574+0000","last_clean":"2024-04-14T10:58:09.208574+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:09.208574+0000","last_undegraded":"2024-04-14T10:58:09.208574+0000","last_fullsized":"2024-04-14T10:58:09.208574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:13.547 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:13.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 Processor -- start 2024-04-14T10:58:13.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 -- start start 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 0x7fc0d406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0d40ce320 0x7fc0d40ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d415acd0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d415af70 con 0x7fc0d40ce320 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.684+0000 7fc0db4de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d415b210 con 0x7fc0d41551d0 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 0x7fc0d406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 0x7fc0d406faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39202/0 (socket says 172.21.15.84:39202) 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d8a79640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0d40ce320 0x7fc0d40ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 -- 172.21.15.84:0/3875988866 learned_addr learned my addr 172.21.15.84:0/3875988866 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:13.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d9a7b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc0d415c6e0 0x7fc0d415cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:60274/0 (socket says 172.21.15.84:60274) 2024-04-14T10:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 -- 172.21.15.84:0/3875988866 >> v2:172.21.15.175:3300/0 conn(0x7fc0d40ce320 msgr2=0x7fc0d40ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 --2- 172.21.15.84:0/3875988866 >> v2:172.21.15.175:3300/0 conn(0x7fc0d40ce320 0x7fc0d40ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 -- 172.21.15.84:0/3875988866 >> v1:172.21.15.175:6789/0 conn(0x7fc0d415c6e0 legacy=0x7fc0d415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.685+0000 7fc0d927a640 1 -- 172.21.15.84:0/3875988866 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d415b4f0 con 0x7fc0d41551d0 2024-04-14T10:58:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.686+0000 7fc0d927a640 1 --2- 172.21.15.84:0/3875988866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 0x7fc0d406faf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009e50 tx=0x7fc0d002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80da746e88bc8328 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.686+0000 7fc0cbfff640 1 -- 172.21.15.84:0/3875988866 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d002cb90 con 0x7fc0d41551d0 2024-04-14T10:58:13.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.686+0000 7fc0cbfff640 1 -- 172.21.15.84:0/3875988866 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d002cd30 con 0x7fc0d41551d0 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.686+0000 7fc0cbfff640 1 -- 172.21.15.84:0/3875988866 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0034610 con 0x7fc0d41551d0 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 -- 172.21.15.84:0/3875988866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 msgr2=0x7fc0d406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 --2- 172.21.15.84:0/3875988866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 0x7fc0d406faf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009e50 tx=0x7fc0d002bff0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 -- 172.21.15.84:0/3875988866 shutdown_connections 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 --2- 172.21.15.84:0/3875988866 >> v2:172.21.15.175:3300/0 conn(0x7fc0d40ce320 0x7fc0d40ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 --2- 172.21.15.84:0/3875988866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d41551d0 0x7fc0d406faf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 -- 172.21.15.84:0/3875988866 >> 172.21.15.84:0/3875988866 conn(0x7fc0d406db10 msgr2=0x7fc0d406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 -- 172.21.15.84:0/3875988866 shutdown_connections 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.687+0000 7fc0db4de640 1 -- 172.21.15.84:0/3875988866 wait complete. 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 Processor -- start 2024-04-14T10:58:13.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 -- start start 2024-04-14T10:58:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d40ce320 0x7fc0d41f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41551d0 0x7fc0d40ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 0x7fc0d41e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d415c1c0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d415bab0 con 0x7fc0d41551d0 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.688+0000 7fc0db4de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d40c8d90 con 0x7fc0d40ce320 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 0x7fc0d41e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 0x7fc0d41e4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43300/0 (socket says 172.21.15.84:43300) 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 -- 172.21.15.84:0/1254584942 learned_addr learned my addr 172.21.15.84:0/1254584942 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d927a640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d40ce320 0x7fc0d41f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d8a79640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41551d0 0x7fc0d40ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 -- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d40ce320 msgr2=0x7fc0d41f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d40ce320 0x7fc0d41f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 -- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41551d0 msgr2=0x7fc0d40ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41551d0 0x7fc0d40ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 -- 172.21.15.84:0/1254584942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d40c9600 con 0x7fc0d415c6e0 2024-04-14T10:58:13.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d8a79640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41551d0 0x7fc0d40ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0d9a7b640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 0x7fc0d41e4390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00c400 tx=0x7fc0cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc0074e0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0cc007680 con 0x7fc0d415c6e0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d40c98e0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc0049e0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.689+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d40c9ea0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.690+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d4069c30 con 0x7fc0d415c6e0 2024-04-14T10:58:13.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.691+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0cc01a020 con 0x7fc0d415c6e0 2024-04-14T10:58:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.691+0000 7fc0c9ffb640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc0b806c8f0 0x7fc0b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.691+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc0cc08b290 con 0x7fc0d415c6e0 2024-04-14T10:58:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.691+0000 7fc0d927a640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc0b806c8f0 0x7fc0b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:13.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.692+0000 7fc0d927a640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc0b806c8f0 0x7fc0b806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0035000 tx=0x7fc0d0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:13.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.695+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc0cc0596c0 con 0x7fc0d415c6e0 2024-04-14T10:58:13.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.866+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0d406f8b0 con 0x7fc0b806c8f0 2024-04-14T10:58:13.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.872+0000 7fc0c9ffb640 1 -- 172.21.15.84:0/1254584942 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7fc0d406f8b0 con 0x7fc0b806c8f0 2024-04-14T10:58:13.875 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:13.877 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc0b806c8f0 msgr2=0x7fc0b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc0b806c8f0 0x7fc0b806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0035000 tx=0x7fc0d0030000 comp rx=0 tx=0).stop 2024-04-14T10:58:13.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 msgr2=0x7fc0d41e4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 0x7fc0d41e4390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00c400 tx=0x7fc0cc00c8c0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 shutdown_connections 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc0b806c8f0 0x7fc0b806edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc0d415c6e0 0x7fc0d41e4390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0d41551d0 0x7fc0d40ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 --2- 172.21.15.84:0/1254584942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0d40ce320 0x7fc0d41f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 >> 172.21.15.84:0/1254584942 conn(0x7fc0d406db10 msgr2=0x7fc0d406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:13.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 shutdown_connections 2024-04-14T10:58:13.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:13.875+0000 7fc0db4de640 1 -- 172.21.15.84:0/1254584942 wait complete. 2024-04-14T10:58:13.885 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-14T10:58:13.403582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.214714"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.421646+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:06.421646+0000","last_peered":"2024-04-14T10:58:06.421646+0000","last_clean":"2024-04-14T10:58:06.421646+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:06.421646+0000","last_undegraded":"2024-04-14T10:58:06.421646+0000","last_fullsized":"2024-04-14T10:58:06.421646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.416971+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:06.416971+0000","last_peered":"2024-04-14T10:58:06.416971+0000","last_clean":"2024-04-14T10:58:06.416971+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:06.416971+0000","last_undegraded":"2024-04-14T10:58:06.416971+0000","last_fullsized":"2024-04-14T10:58:06.416971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571212+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:05.571212+0000","last_peered":"2024-04-14T10:58:05.571212+0000","last_clean":"2024-04-14T10:58:05.571212+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:05.571212+0000","last_undegraded":"2024-04-14T10:58:05.571212+0000","last_fullsized":"2024-04-14T10:58:05.571212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202831+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:05.202831+0000","last_peered":"2024-04-14T10:58:05.202831+0000","last_clean":"2024-04-14T10:58:05.202831+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:05.202831+0000","last_undegraded":"2024-04-14T10:58:05.202831+0000","last_fullsized":"2024-04-14T10:58:05.202831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571625+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:05.571625+0000","last_peered":"2024-04-14T10:58:05.571625+0000","last_clean":"2024-04-14T10:58:05.571625+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:05.571625+0000","last_undegraded":"2024-04-14T10:58:05.571625+0000","last_fullsized":"2024-04-14T10:58:05.571625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202909+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:05.202909+0000","last_peered":"2024-04-14T10:58:05.202909+0000","last_clean":"2024-04-14T10:58:05.202909+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:05.202909+0000","last_undegraded":"2024-04-14T10:58:05.202909+0000","last_fullsized":"2024-04-14T10:58:05.202909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208453+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:09.208453+0000","last_peered":"2024-04-14T10:58:09.208453+0000","last_clean":"2024-04-14T10:58:09.208453+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:09.208453+0000","last_undegraded":"2024-04-14T10:58:09.208453+0000","last_fullsized":"2024-04-14T10:58:09.208453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208083+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:09.208083+0000","last_peered":"2024-04-14T10:58:09.208083+0000","last_clean":"2024-04-14T10:58:09.208083+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:09.208083+0000","last_undegraded":"2024-04-14T10:58:09.208083+0000","last_fullsized":"2024-04-14T10:58:09.208083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.205569+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:09.205569+0000","last_peered":"2024-04-14T10:58:09.205569+0000","last_clean":"2024-04-14T10:58:09.205569+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:09.205569+0000","last_undegraded":"2024-04-14T10:58:09.205569+0000","last_fullsized":"2024-04-14T10:58:09.205569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203292+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:05.203292+0000","last_peered":"2024-04-14T10:58:05.203292+0000","last_clean":"2024-04-14T10:58:05.203292+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:05.203292+0000","last_undegraded":"2024-04-14T10:58:05.203292+0000","last_fullsized":"2024-04-14T10:58:05.203292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571308+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:05.571308+0000","last_peered":"2024-04-14T10:58:05.571308+0000","last_clean":"2024-04-14T10:58:05.571308+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:05.571308+0000","last_undegraded":"2024-04-14T10:58:05.571308+0000","last_fullsized":"2024-04-14T10:58:05.571308+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.205298+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:09.205298+0000","last_peered":"2024-04-14T10:58:09.205298+0000","last_clean":"2024-04-14T10:58:09.205298+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:09.205298+0000","last_undegraded":"2024-04-14T10:58:09.205298+0000","last_fullsized":"2024-04-14T10:58:09.205298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417439+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:06.417439+0000","last_peered":"2024-04-14T10:58:06.417439+0000","last_clean":"2024-04-14T10:58:06.417439+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:06.417439+0000","last_undegraded":"2024-04-14T10:58:06.417439+0000","last_fullsized":"2024-04-14T10:58:06.417439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203250+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:09.203250+0000","last_peered":"2024-04-14T10:58:09.203250+0000","last_clean":"2024-04-14T10:58:09.203250+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:09.203250+0000","last_undegraded":"2024-04-14T10:58:09.203250+0000","last_fullsized":"2024-04-14T10:58:09.203250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422915+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:06.422915+0000","last_peered":"2024-04-14T10:58:06.422915+0000","last_clean":"2024-04-14T10:58:06.422915+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:06.422915+0000","last_undegraded":"2024-04-14T10:58:06.422915+0000","last_fullsized":"2024-04-14T10:58:06.422915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571568+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:05.571568+0000","last_peered":"2024-04-14T10:58:05.571568+0000","last_clean":"2024-04-14T10:58:05.571568+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:05.571568+0000","last_undegraded":"2024-04-14T10:58:05.571568+0000","last_fullsized":"2024-04-14T10:58:05.571568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202728+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:05.202728+0000","last_peered":"2024-04-14T10:58:05.202728+0000","last_clean":"2024-04-14T10:58:05.202728+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:05.202728+0000","last_undegraded":"2024-04-14T10:58:05.202728+0000","last_fullsized":"2024-04-14T10:58:05.202728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571456+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:05.571456+0000","last_peered":"2024-04-14T10:58:05.571456+0000","last_clean":"2024-04-14T10:58:05.571456+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:05.571456+0000","last_undegraded":"2024-04-14T10:58:05.571456+0000","last_fullsized":"2024-04-14T10:58:05.571456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571147+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:05.571147+0000","last_peered":"2024-04-14T10:58:05.571147+0000","last_clean":"2024-04-14T10:58:05.571147+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:05.571147+0000","last_undegraded":"2024-04-14T10:58:05.571147+0000","last_fullsized":"2024-04-14T10:58:05.571147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203427+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:05.203427+0000","last_peered":"2024-04-14T10:58:05.203427+0000","last_clean":"2024-04-14T10:58:05.203427+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:05.203427+0000","last_undegraded":"2024-04-14T10:58:05.203427+0000","last_fullsized":"2024-04-14T10:58:05.203427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572451+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:05.572451+0000","last_peered":"2024-04-14T10:58:05.572451+0000","last_clean":"2024-04-14T10:58:05.572451+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:05.572451+0000","last_undegraded":"2024-04-14T10:58:05.572451+0000","last_fullsized":"2024-04-14T10:58:05.572451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197652+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:05.197652+0000","last_peered":"2024-04-14T10:58:05.197652+0000","last_clean":"2024-04-14T10:58:05.197652+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:05.197652+0000","last_undegraded":"2024-04-14T10:58:05.197652+0000","last_fullsized":"2024-04-14T10:58:05.197652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.202682+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:09.202682+0000","last_peered":"2024-04-14T10:58:09.202682+0000","last_clean":"2024-04-14T10:58:09.202682+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:09.202682+0000","last_undegraded":"2024-04-14T10:58:09.202682+0000","last_fullsized":"2024-04-14T10:58:09.202682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571306+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:05.571306+0000","last_peered":"2024-04-14T10:58:05.571306+0000","last_clean":"2024-04-14T10:58:05.571306+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:05.571306+0000","last_undegraded":"2024-04-14T10:58:05.571306+0000","last_fullsized":"2024-04-14T10:58:05.571306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197542+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:05.197542+0000","last_peered":"2024-04-14T10:58:05.197542+0000","last_clean":"2024-04-14T10:58:05.197542+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:05.197542+0000","last_undegraded":"2024-04-14T10:58:05.197542+0000","last_fullsized":"2024-04-14T10:58:05.197542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197582+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:05.197582+0000","last_peered":"2024-04-14T10:58:05.197582+0000","last_clean":"2024-04-14T10:58:05.197582+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:05.197582+0000","last_undegraded":"2024-04-14T10:58:05.197582+0000","last_fullsized":"2024-04-14T10:58:05.197582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208078+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:09.208078+0000","last_peered":"2024-04-14T10:58:09.208078+0000","last_clean":"2024-04-14T10:58:09.208078+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:09.208078+0000","last_undegraded":"2024-04-14T10:58:09.208078+0000","last_fullsized":"2024-04-14T10:58:09.208078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208343+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:09.208343+0000","last_peered":"2024-04-14T10:58:09.208343+0000","last_clean":"2024-04-14T10:58:09.208343+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:09.208343+0000","last_undegraded":"2024-04-14T10:58:09.208343+0000","last_fullsized":"2024-04-14T10:58:09.208343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208092+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:09.208092+0000","last_peered":"2024-04-14T10:58:09.208092+0000","last_clean":"2024-04-14T10:58:09.208092+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:09.208092+0000","last_undegraded":"2024-04-14T10:58:09.208092+0000","last_fullsized":"2024-04-14T10:58:09.208092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.421668+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:06.421668+0000","last_peered":"2024-04-14T10:58:06.421668+0000","last_clean":"2024-04-14T10:58:06.421668+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:06.421668+0000","last_undegraded":"2024-04-14T10:58:06.421668+0000","last_fullsized":"2024-04-14T10:58:06.421668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208574+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:09.208574+0000","last_peered":"2024-04-14T10:58:09.208574+0000","last_clean":"2024-04-14T10:58:09.208574+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:09.208574+0000","last_undegraded":"2024-04-14T10:58:09.208574+0000","last_fullsized":"2024-04-14T10:58:09.208574+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:13.892 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T10:58:13.892 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-14T10:58:13.892 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-14T10:58:13.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-14T10:58:14.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.025+0000 7f00143c8640 1 Processor -- start 2024-04-14T10:58:14.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.025+0000 7f00143c8640 1 -- start start 2024-04-14T10:58:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f00143c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f000c0b4300 0x7f000c159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f00143c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f000c0c34b0 0x7f000c0c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f00143c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c0c3a80 con 0x7f000c152d40 2024-04-14T10:58:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f00143c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f000c0ca480 con 0x7f000c0b4300 2024-04-14T10:58:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f00143c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f000c159a50 con 0x7f000c0c34b0 2024-04-14T10:58:14.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f0011963640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f000c0b4300 0x7f000c159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f0011963640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f000c0b4300 0x7f000c159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43314/0 (socket says 172.21.15.84:43314) 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.026+0000 7f0011963640 1 -- 172.21.15.84:0/3019381470 learned_addr learned my addr 172.21.15.84:0/3019381470 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0012965640 1 --2- 172.21.15.84:0/3019381470 >> v2:172.21.15.175:3300/0 conn(0x7f000c0c34b0 0x7f000c0c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011963640 1 -- 172.21.15.84:0/3019381470 >> v2:172.21.15.175:3300/0 conn(0x7f000c0c34b0 msgr2=0x7f000c0c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011963640 1 --2- 172.21.15.84:0/3019381470 >> v2:172.21.15.175:3300/0 conn(0x7f000c0c34b0 0x7f000c0c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011963640 1 -- 172.21.15.84:0/3019381470 >> v1:172.21.15.175:6789/0 conn(0x7f000c152d40 legacy=0x7f000c070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011963640 1 -- 172.21.15.84:0/3019381470 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c0c8fa0 con 0x7f000c0b4300 2024-04-14T10:58:14.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0012965640 1 --2- 172.21.15.84:0/3019381470 >> v2:172.21.15.175:3300/0 conn(0x7f000c0c34b0 0x7f000c0c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011963640 1 --2- 172.21.15.84:0/3019381470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c159510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f000c071200 tx=0x7efffc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19544c06f545eaa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011162640 1 -- 172.21.15.84:0/3019381470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc035020 con 0x7f000c0b4300 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011162640 1 -- 172.21.15.84:0/3019381470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc031870 con 0x7f000c0b4300 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.027+0000 7f0011162640 1 -- 172.21.15.84:0/3019381470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc031c40 con 0x7f000c0b4300 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 -- 172.21.15.84:0/3019381470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 msgr2=0x7f000c159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 --2- 172.21.15.84:0/3019381470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c159510 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f000c071200 tx=0x7efffc02b910 comp rx=0 tx=0).stop 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 -- 172.21.15.84:0/3019381470 shutdown_connections 2024-04-14T10:58:14.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 --2- 172.21.15.84:0/3019381470 >> v2:172.21.15.175:3300/0 conn(0x7f000c0c34b0 0x7f000c0c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 --2- 172.21.15.84:0/3019381470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c159510 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 -- 172.21.15.84:0/3019381470 >> 172.21.15.84:0/3019381470 conn(0x7f000c071590 msgr2=0x7f000c071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 -- 172.21.15.84:0/3019381470 shutdown_connections 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.028+0000 7f00143c8640 1 -- 172.21.15.84:0/3019381470 wait complete. 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.029+0000 7f00143c8640 1 Processor -- start 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.029+0000 7f00143c8640 1 -- start start 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f00143c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c0b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:14.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f00143c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000c0c34b0 0x7f000c0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f00143c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000c152d40 0x7f000c1f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f00143c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f000c06f900 con 0x7f000c0b4300 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f00143c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f000c06fc70 con 0x7f000c152d40 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f00143c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f000c153120 con 0x7f000c0c34b0 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c0b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c0b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43328/0 (socket says 172.21.15.84:43328) 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 -- 172.21.15.84:0/386172964 learned_addr learned my addr 172.21.15.84:0/386172964 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:14.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0011963640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000c0c34b0 0x7f000c0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012965640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000c152d40 0x7f000c1f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 -- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000c0c34b0 msgr2=0x7f000c0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000c0c34b0 0x7f000c0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 -- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000c152d40 msgr2=0x7f000c1f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000c152d40 0x7f000c1f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 -- 172.21.15.84:0/386172964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c151350 con 0x7f000c0b4300 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012965640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000c152d40 0x7f000c1f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:14.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.030+0000 7f0012164640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c0b0f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f000800ba80 tx=0x7f000800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.031+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000800cc00 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.031+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000800cda0 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.031+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008003bb0 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.031+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c1515f0 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.031+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c151bb0 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.031+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c069c30 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.032+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0008014440 con 0x7f000c0b4300 2024-04-14T10:58:14.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.032+0000 7f0002ffd640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efff006c920 0x7efff006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.033+0000 7f0011963640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efff006c920 0x7efff006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.033+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f000808b9e0 con 0x7f000c0b4300 2024-04-14T10:58:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.033+0000 7f0011963640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efff006c920 0x7efff006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efffc036000 tx=0x7efffc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:14.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.037+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f0008059ea0 con 0x7f000c0b4300 2024-04-14T10:58:14.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.255+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f000c0c9720 con 0x7f000c0b4300 2024-04-14T10:58:14.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.255+0000 7f0002ffd640 1 -- 172.21.15.84:0/386172964 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f00080597a0 con 0x7f000c0b4300 2024-04-14T10:58:14.254 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:14.255 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-14T10:58:14.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efff006c920 msgr2=0x7efff006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efff006c920 0x7efff006ede0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efffc036000 tx=0x7efffc03c040 comp rx=0 tx=0).stop 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 msgr2=0x7f000c0b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c0b0f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f000800ba80 tx=0x7f000800bf40 comp rx=0 tx=0).stop 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 shutdown_connections 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efff006c920 0x7efff006ede0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000c152d40 0x7f000c1f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000c0c34b0 0x7f000c0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 --2- 172.21.15.84:0/386172964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f000c0b4300 0x7f000c0b0f50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:14.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 >> 172.21.15.84:0/386172964 conn(0x7f000c071590 msgr2=0x7f000c157120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:14.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 shutdown_connections 2024-04-14T10:58:14.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:14.257+0000 7f00143c8640 1 -- 172.21.15.84:0/386172964 wait complete. 2024-04-14T10:58:17.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-14T10:58:17.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 Processor -- start 2024-04-14T10:58:17.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 -- start start 2024-04-14T10:58:17.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 0x7fe9b415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 0x7fe9b406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b40cc830 con 0x7fe9b406d420 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe9b415bd30 con 0x7fe9b4154f60 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.381+0000 7fe9babb4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b40cafe0 con 0x7fe9b40cbe50 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 0x7fe9b406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b8950640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 0x7fe9b415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 0x7fe9b406cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39230/0 (socket says 172.21.15.84:39230) 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b9151640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe9b406d420 0x7fe9b415e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:60280/0 (socket says 172.21.15.84:60280) 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b8950640 1 --2- 172.21.15.84:0/2187157134 >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 0x7fe9b415b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:44874/0 (socket says 172.21.15.84:44874) 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 -- 172.21.15.84:0/2187157134 learned_addr learned my addr 172.21.15.84:0/2187157134 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 -- 172.21.15.84:0/2187157134 >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 msgr2=0x7fe9b415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 --2- 172.21.15.84:0/2187157134 >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 0x7fe9b415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 -- 172.21.15.84:0/2187157134 >> v1:172.21.15.175:6789/0 conn(0x7fe9b406d420 legacy=0x7fe9b415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b3fff640 1 -- 172.21.15.84:0/2187157134 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b40cb2c0 con 0x7fe9b40cbe50 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.382+0000 7fe9b8950640 1 --2- 172.21.15.84:0/2187157134 >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 0x7fe9b415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:17.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.383+0000 7fe9b3fff640 1 --2- 172.21.15.84:0/2187157134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 0x7fe9b406cee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009870 tx=0x7fe9a002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d8310d779827ae6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.383+0000 7fe9b37fe640 1 -- 172.21.15.84:0/2187157134 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002f840 con 0x7fe9b40cbe50 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.383+0000 7fe9b37fe640 1 -- 172.21.15.84:0/2187157134 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a002f9e0 con 0x7fe9b40cbe50 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.383+0000 7fe9b37fe640 1 -- 172.21.15.84:0/2187157134 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a002fdb0 con 0x7fe9b40cbe50 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.383+0000 7fe9babb4640 1 -- 172.21.15.84:0/2187157134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 msgr2=0x7fe9b406cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.383+0000 7fe9babb4640 1 --2- 172.21.15.84:0/2187157134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 0x7fe9b406cee0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0009870 tx=0x7fe9a002ba20 comp rx=0 tx=0).stop 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.384+0000 7fe9babb4640 1 -- 172.21.15.84:0/2187157134 shutdown_connections 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.384+0000 7fe9babb4640 1 --2- 172.21.15.84:0/2187157134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b40cbe50 0x7fe9b406cee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.384+0000 7fe9babb4640 1 --2- 172.21.15.84:0/2187157134 >> v2:172.21.15.175:3300/0 conn(0x7fe9b4154f60 0x7fe9b415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.384+0000 7fe9babb4640 1 -- 172.21.15.84:0/2187157134 >> 172.21.15.84:0/2187157134 conn(0x7fe9b40729b0 msgr2=0x7fe9b4067720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:17.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.384+0000 7fe9babb4640 1 -- 172.21.15.84:0/2187157134 shutdown_connections 2024-04-14T10:58:17.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.384+0000 7fe9babb4640 1 -- 172.21.15.84:0/2187157134 wait complete. 2024-04-14T10:58:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.385+0000 7fe9babb4640 1 Processor -- start 2024-04-14T10:58:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.385+0000 7fe9babb4640 1 -- start start 2024-04-14T10:58:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 0x7fe9b40c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9b40cbe50 0x7fe9b41f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b4154f60 0x7fe9b414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b40cc270 con 0x7fe9b4154f60 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b40ccf70 con 0x7fe9b40cbe50 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b41f08c0 con 0x7fe9b406d420 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 0x7fe9b40c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9b40cbe50 0x7fe9b41f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b9151640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b4154f60 0x7fe9b414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 0x7fe9b40c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39242/0 (socket says 172.21.15.84:39242) 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 -- 172.21.15.84:0/1321941375 learned_addr learned my addr 172.21.15.84:0/1321941375 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 -- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9b40cbe50 msgr2=0x7fe9b41f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9b40cbe50 0x7fe9b41f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 -- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b4154f60 msgr2=0x7fe9b414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b4154f60 0x7fe9b414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 -- 172.21.15.84:0/1321941375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b40b51c0 con 0x7fe9b406d420 2024-04-14T10:58:17.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b3fff640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9b40cbe50 0x7fe9b41f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b8950640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 0x7fe9b40c80c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e960 tx=0x7fe9a800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8017070 con 0x7fe9b406d420 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a800ca00 con 0x7fe9b406d420 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800cdd0 con 0x7fe9b406d420 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b40b4c10 con 0x7fe9b406d420 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.386+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b40b5720 con 0x7fe9b406d420 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.387+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b40b5960 con 0x7fe9b406d420 2024-04-14T10:58:17.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.388+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9a801a070 con 0x7fe9b406d420 2024-04-14T10:58:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.388+0000 7fe9b17fa640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe99806c920 0x7fe99806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.388+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9a808b9c0 con 0x7fe9b406d420 2024-04-14T10:58:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.388+0000 7fe9b3fff640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe99806c920 0x7fe99806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.389+0000 7fe9b3fff640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe99806c920 0x7fe99806ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0036000 tx=0x7fe9a0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:17.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.393+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fe9b40b5960 con 0x7fe9b406d420 2024-04-14T10:58:17.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.606+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe9b4069c30 con 0x7fe9b406d420 2024-04-14T10:58:17.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.607+0000 7fe9b17fa640 1 -- 172.21.15.84:0/1321941375 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe9a808de20 con 0x7fe9b406d420 2024-04-14T10:58:17.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:17.606 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-14T10:58:17.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe99806c920 msgr2=0x7fe99806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe99806c920 0x7fe99806ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9a0036000 tx=0x7fe9a0008030 comp rx=0 tx=0).stop 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 msgr2=0x7fe9b40c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 0x7fe9b40c80c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e960 tx=0x7fe9a800ee20 comp rx=0 tx=0).stop 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 shutdown_connections 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe99806c920 0x7fe99806ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe9b4154f60 0x7fe9b414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9b40cbe50 0x7fe9b41f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 --2- 172.21.15.84:0/1321941375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9b406d420 0x7fe9b40c80c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 >> 172.21.15.84:0/1321941375 conn(0x7fe9b40729b0 msgr2=0x7fe9b4067720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:17.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 shutdown_connections 2024-04-14T10:58:17.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.609+0000 7fe9babb4640 1 -- 172.21.15.84:0/1321941375 wait complete. 2024-04-14T10:58:17.619 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-14T10:58:17.619 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:17.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.721+0000 7f40cc915640 1 Processor -- start 2024-04-14T10:58:17.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.721+0000 7f40cc915640 1 -- start start 2024-04-14T10:58:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40cc915640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f40c8155160 0x7f40c80cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40cc915640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40c80b3930 0x7f40c80cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40cc915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c815afc0 0x7f40c815b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40cc915640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f40c815b990 con 0x7f40c80b3930 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40cc915640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f40c80ccd90 con 0x7f40c8155160 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40cc915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f40c815e4d0 con 0x7f40c815afc0 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40c80b3930 0x7f40c80cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f40c80b3930 0x7f40c80cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43348/0 (socket says 172.21.15.84:43348) 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40c6d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c815afc0 0x7f40c815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 -- 172.21.15.84:0/3433433026 learned_addr learned my addr 172.21.15.84:0/3433433026 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40c659c640 1 --2- 172.21.15.84:0/3433433026 >> v2:172.21.15.175:3300/0 conn(0x7f40c8155160 0x7f40c80cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 -- 172.21.15.84:0/3433433026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c815afc0 msgr2=0x7f40c815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 --2- 172.21.15.84:0/3433433026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c815afc0 0x7f40c815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 -- 172.21.15.84:0/3433433026 >> v2:172.21.15.175:3300/0 conn(0x7f40c8155160 msgr2=0x7f40c80cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 --2- 172.21.15.84:0/3433433026 >> v2:172.21.15.175:3300/0 conn(0x7f40c8155160 0x7f40c80cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.722+0000 7f40bffff640 1 -- 172.21.15.84:0/3433433026 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c815e7b0 con 0x7f40c80b3930 2024-04-14T10:58:17.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40bffff640 1 --2- 172.21.15.84:0/3433433026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c80b3930 0x7f40c80cb910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40c808e060 tx=0x7f40b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fde171b9c39cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40c5d9b640 1 -- 172.21.15.84:0/3433433026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0034070 con 0x7f40c80b3930 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40c5d9b640 1 -- 172.21.15.84:0/3433433026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b0030860 con 0x7f40c80b3930 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40c5d9b640 1 -- 172.21.15.84:0/3433433026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0030c30 con 0x7f40c80b3930 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 -- 172.21.15.84:0/3433433026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c80b3930 msgr2=0x7f40c80cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 --2- 172.21.15.84:0/3433433026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c80b3930 0x7f40c80cb910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f40c808e060 tx=0x7f40b002b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 -- 172.21.15.84:0/3433433026 shutdown_connections 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 --2- 172.21.15.84:0/3433433026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c815afc0 0x7f40c815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 --2- 172.21.15.84:0/3433433026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c80b3930 0x7f40c80cb910 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 --2- 172.21.15.84:0/3433433026 >> v2:172.21.15.175:3300/0 conn(0x7f40c8155160 0x7f40c80cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.723+0000 7f40cc915640 1 -- 172.21.15.84:0/3433433026 >> 172.21.15.84:0/3433433026 conn(0x7f40c806b900 msgr2=0x7f40c806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:17.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.724+0000 7f40cc915640 1 -- 172.21.15.84:0/3433433026 shutdown_connections 2024-04-14T10:58:17.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.724+0000 7f40cc915640 1 -- 172.21.15.84:0/3433433026 wait complete. 2024-04-14T10:58:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.725+0000 7f40cc915640 1 Processor -- start 2024-04-14T10:58:17.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.725+0000 7f40cc915640 1 -- start start 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.725+0000 7f40cc915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c80b3930 0x7f40c80d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.725+0000 7f40cc915640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 0x7f40c81f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.725+0000 7f40cc915640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c815afc0 0x7f40c81f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40cc915640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f40c815f050 con 0x7f40c8155160 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40cc915640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40c815ed70 con 0x7f40c815afc0 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40cc915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f40c8155540 con 0x7f40c80b3930 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 0x7f40c81f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 0x7f40c81f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43360/0 (socket says 172.21.15.84:43360) 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 -- 172.21.15.84:0/3246389828 learned_addr learned my addr 172.21.15.84:0/3246389828 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40c659c640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c80b3930 0x7f40c80d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40c6d9d640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c815afc0 0x7f40c81f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 -- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c80b3930 msgr2=0x7f40c80d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c80b3930 0x7f40c80d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 -- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c815afc0 msgr2=0x7f40c81f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c815afc0 0x7f40c81f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 -- 172.21.15.84:0/3246389828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c80cf8f0 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40bffff640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 0x7f40c81f0da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40b002b9e0 tx=0x7f40b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0048070 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b0030660 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c80cfbd0 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0034040 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.726+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c80d0190 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.727+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c8069c30 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.727+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f40b004b070 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.728+0000 7f40beffd640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.728+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f40b00ada20 con 0x7f40c8155160 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.728+0000 7f40c659c640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:17.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.728+0000 7f40c659c640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f40a806c8f0 0x7f40a806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009ac0 tx=0x7f40b8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:17.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.732+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f40b0030830 con 0x7f40c8155160 2024-04-14T10:58:17.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.908+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40c80c7460 con 0x7f40c8155160 2024-04-14T10:58:17.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.909+0000 7f40beffd640 1 -- 172.21.15.84:0/3246389828 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f40b007b800 con 0x7f40c8155160 2024-04-14T10:58:17.908 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:17.908 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f40a806c8f0 msgr2=0x7f40a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f40a806c8f0 0x7f40a806edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009ac0 tx=0x7f40b8009190 comp rx=0 tx=0).stop 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 msgr2=0x7f40c81f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 0x7f40c81f0da0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40b002b9e0 tx=0x7f40b0004730 comp rx=0 tx=0).stop 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 shutdown_connections 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40c815afc0 0x7f40c81f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f40c8155160 0x7f40c81f0da0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 --2- 172.21.15.84:0/3246389828 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f40c80b3930 0x7f40c80d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 >> 172.21.15.84:0/3246389828 conn(0x7f40c806b900 msgr2=0x7f40c815c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 shutdown_connections 2024-04-14T10:58:17.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:17.911+0000 7f40cc915640 1 -- 172.21.15.84:0/3246389828 wait complete. 2024-04-14T10:58:17.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:58:17.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:58:18.018 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-14T10:58:18.020+0000 7fe1259f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T10:58:18.018 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-14T10:58:18.020+0000 7fe1259f1640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-14T10:58:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.026+0000 7fc5c535e640 1 Processor -- start 2024-04-14T10:58:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.026+0000 7fc5c535e640 1 -- start start 2024-04-14T10:58:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5c535e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc5c0155130 0x7fc5c00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5c535e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5c00cce20 0x7fc5c00b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5c535e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5c535e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c015f2d0 con 0x7fc5c00cce20 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5c535e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c015e470 con 0x7fc5c0155130 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5c535e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c015e750 con 0x7fc5c00cb450 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5c00cce20 0x7fc5c00b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc5c00cce20 0x7fc5c00b62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43368/0 (socket says 172.21.15.84:43368) 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1185927445 learned_addr learned my addr 172.21.15.84:0/1185927445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5beffd640 1 --2- 172.21.15.84:0/1185927445 >> v2:172.21.15.175:3300/0 conn(0x7fc5c0155130 0x7fc5c00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5bf7fe640 1 --2- 172.21.15.84:0/1185927445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1185927445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 msgr2=0x7fc5c00cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 --2- 172.21.15.84:0/1185927445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1185927445 >> v2:172.21.15.175:3300/0 conn(0x7fc5c0155130 msgr2=0x7fc5c00cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 --2- 172.21.15.84:0/1185927445 >> v2:172.21.15.175:3300/0 conn(0x7fc5c0155130 0x7fc5c00cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.027+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1185927445 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c015ea30 con 0x7fc5c00cce20 2024-04-14T10:58:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.028+0000 7fc5b7fff640 1 --2- 172.21.15.84:0/1185927445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c00b62e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0073130 tx=0x7fc5a802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c8eaa91e2ba824 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.028+0000 7fc5be7fc640 1 -- 172.21.15.84:0/1185927445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8034070 con 0x7fc5c00cce20 2024-04-14T10:58:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.028+0000 7fc5be7fc640 1 -- 172.21.15.84:0/1185927445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8030860 con 0x7fc5c00cce20 2024-04-14T10:58:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.028+0000 7fc5be7fc640 1 -- 172.21.15.84:0/1185927445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8030c30 con 0x7fc5c00cce20 2024-04-14T10:58:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 -- 172.21.15.84:0/1185927445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 msgr2=0x7fc5c00b62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1185927445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c00b62e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0073130 tx=0x7fc5a802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 -- 172.21.15.84:0/1185927445 shutdown_connections 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1185927445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1185927445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c00b62e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1185927445 >> v2:172.21.15.175:3300/0 conn(0x7fc5c0155130 0x7fc5c00cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 -- 172.21.15.84:0/1185927445 >> 172.21.15.84:0/1185927445 conn(0x7fc5c00d07b0 msgr2=0x7fc5c00d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 -- 172.21.15.84:0/1185927445 shutdown_connections 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.029+0000 7fc5c535e640 1 -- 172.21.15.84:0/1185927445 wait complete. 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.030+0000 7fc5c535e640 1 Processor -- start 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.030+0000 7fc5c535e640 1 -- start start 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.030+0000 7fc5c535e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.030+0000 7fc5c535e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c01e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5c535e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c0155130 0x7fc5c014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5c535e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c0155510 con 0x7fc5c00cce20 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5c535e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c015eff0 con 0x7fc5c0155130 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5c535e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c015b170 con 0x7fc5c00cb450 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c01e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c01e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43378/0 (socket says 172.21.15.84:43378) 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1386255709 learned_addr learned my addr 172.21.15.84:0/1386255709 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5beffd640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5bf7fe640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c0155130 0x7fc5c014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 msgr2=0x7fc5c00c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c0155130 msgr2=0x7fc5c014bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c0155130 0x7fc5c014bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 -- 172.21.15.84:0/1386255709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c01f0c10 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b7fff640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c01e7d20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8000c00 tx=0x7fc5a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8048070 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a8030660 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8034040 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c01504d0 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.031+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c01f0ed0 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.032+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c00c6900 con 0x7fc5c00cce20 2024-04-14T10:58:18.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.032+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5a804b070 con 0x7fc5c00cce20 2024-04-14T10:58:18.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.033+0000 7fc5b77fe640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc5a006c8f0 0x7fc5a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.033+0000 7fc5beffd640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc5a006c8f0 0x7fc5a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.033+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc5a80adaa0 con 0x7fc5c00cce20 2024-04-14T10:58:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.033+0000 7fc5beffd640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc5a006c8f0 0x7fc5a006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009aa0 tx=0x7fc5b0009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.037+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc5c00c6900 con 0x7fc5c00cce20 2024-04-14T10:58:18.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.211+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc5c0069b20 con 0x7fc5c00cce20 2024-04-14T10:58:18.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.212+0000 7fc5b77fe640 1 -- 172.21.15.84:0/1386255709 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc5a8030830 con 0x7fc5c00cce20 2024-04-14T10:58:18.211 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc5a006c8f0 msgr2=0x7fc5a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc5a006c8f0 0x7fc5a006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009aa0 tx=0x7fc5b0009190 comp rx=0 tx=0).stop 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 msgr2=0x7fc5c01e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c01e7d20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8000c00 tx=0x7fc5a8004730 comp rx=0 tx=0).stop 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 shutdown_connections 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc5a006c8f0 0x7fc5a006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5c0155130 0x7fc5c014bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c00cce20 0x7fc5c01e7d20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 --2- 172.21.15.84:0/1386255709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5c00cb450 0x7fc5c00c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 >> 172.21.15.84:0/1386255709 conn(0x7fc5c00d07b0 msgr2=0x7fc5c0072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 shutdown_connections 2024-04-14T10:58:18.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.214+0000 7fc5c535e640 1 -- 172.21.15.84:0/1386255709 wait complete. 2024-04-14T10:58:18.223 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:58:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.328+0000 7f8ce7880640 1 Processor -- start 2024-04-14T10:58:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce7880640 1 -- start start 2024-04-14T10:58:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce7880640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00c5000 0x7f8ce015b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce7880640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce00c91c0 con 0x7f8ce006b900 2024-04-14T10:58:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce7880640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce00c94a0 con 0x7f8ce0070360 2024-04-14T10:58:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce7880640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce00c53e0 con 0x7f8ce00c5000 2024-04-14T10:58:18.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce4e1b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f8ce006b900 0x7f8ce006c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48048/0 (socket says 172.21.15.84:48048) 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.329+0000 7f8ce4e1b640 1 -- 172.21.15.84:0/4037207910 learned_addr learned my addr 172.21.15.84:0/4037207910 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8ce561c640 1 --2- 172.21.15.84:0/4037207910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00c5000 0x7f8ce015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538402799 0 0) 0x7f8ce00c91c0 con 0x7f8ce006b900 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ccc003520 con 0x7f8ce006b900 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098907894 0 0) 0x7f8ce00c94a0 con 0x7f8ce0070360 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce00c91c0 con 0x7f8ce0070360 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8ce561c640 1 -- 172.21.15.84:0/4037207910 >> v1:172.21.15.175:6789/0 conn(0x7f8ce0070360 legacy=0x7f8ce0165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8ce561c640 1 -- 172.21.15.84:0/4037207910 >> v1:172.21.15.84:6789/0 conn(0x7f8ce006b900 legacy=0x7f8ce006c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.330+0000 7f8ce561c640 1 -- 172.21.15.84:0/4037207910 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce006f880 con 0x7f8ce00c5000 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce561c640 1 --2- 172.21.15.84:0/4037207910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00c5000 0x7f8ce015b970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097d0 tx=0x7f8cdc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d2a8d0a948d745 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc035020 con 0x7f8ce00c5000 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc031890 con 0x7f8ce00c5000 2024-04-14T10:58:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8cd7fff640 1 -- 172.21.15.84:0/4037207910 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc031c60 con 0x7f8ce00c5000 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 -- 172.21.15.84:0/4037207910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00c5000 msgr2=0x7f8ce015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 --2- 172.21.15.84:0/4037207910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00c5000 0x7f8ce015b970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0097d0 tx=0x7f8cdc02b930 comp rx=0 tx=0).stop 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 -- 172.21.15.84:0/4037207910 shutdown_connections 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 --2- 172.21.15.84:0/4037207910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00c5000 0x7f8ce015b970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 -- 172.21.15.84:0/4037207910 >> 172.21.15.84:0/4037207910 conn(0x7f8ce00ce570 msgr2=0x7f8ce00ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 -- 172.21.15.84:0/4037207910 shutdown_connections 2024-04-14T10:58:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.331+0000 7f8ce7880640 1 -- 172.21.15.84:0/4037207910 wait complete. 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.332+0000 7f8ce7880640 1 Processor -- start 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 -- start start 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 0x7f8ce0157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce0070360 0x7f8ce015e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 0x7f8ce015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce006fed0 con 0x7f8ce00c5000 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce00c8f70 con 0x7f8ce006b900 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce7880640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce006cf30 con 0x7f8ce0070360 2024-04-14T10:58:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce5e1d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 0x7f8ce015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce561c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 0x7f8ce0157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce561c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 0x7f8ce0157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:44928/0 (socket says 172.21.15.84:44928) 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce5e1d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 0x7f8ce015ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43388/0 (socket says 172.21.15.84:43388) 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce561c640 1 -- 172.21.15.84:0/723853914 learned_addr learned my addr 172.21.15.84:0/723853914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.333+0000 7f8ce4e1b640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce0070360 0x7f8ce015e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce561c640 1 -- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce0070360 msgr2=0x7f8ce015e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce561c640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce0070360 0x7f8ce015e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce561c640 1 -- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 msgr2=0x7f8ce015ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce561c640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 0x7f8ce015ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce561c640 1 -- 172.21.15.84:0/723853914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce01f45d0 con 0x7f8ce006b900 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce5e1d640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 0x7f8ce015ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce561c640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 0x7f8ce0157640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0098f0 tx=0x7f8cdc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc035040 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc030d20 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0456c0 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce01f48b0 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.334+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce01f4e70 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.335+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce01f50b0 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.336+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8cdc038020 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.336+0000 7f8cd5ffb640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8cc406c8f0 0x7f8cc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.336+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8cdc0addd0 con 0x7f8ce006b900 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.336+0000 7f8ce4e1b640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8cc406c8f0 0x7f8cc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.336+0000 7f8ce4e1b640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8cc406c8f0 0x7f8cc406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00c48c0 tx=0x7f8cd0007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.341+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f8ce01f50b0 con 0x7f8ce006b900 2024-04-14T10:58:18.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.514+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8ce0069b20 con 0x7f8ce006b900 2024-04-14T10:58:18.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.514+0000 7f8cd5ffb640 1 -- 172.21.15.84:0/723853914 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8cdc0af020 con 0x7f8ce006b900 2024-04-14T10:58:18.514 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T10:58:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8cc406c8f0 msgr2=0x7f8cc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8cc406c8f0 0x7f8cc406edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00c48c0 tx=0x7f8cd0007d30 comp rx=0 tx=0).stop 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 msgr2=0x7f8ce0157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 0x7f8ce0157640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0098f0 tx=0x7f8cdc0046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 shutdown_connections 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8cc406c8f0 0x7f8cc406edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8ce00c5000 0x7f8ce015ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce0070360 0x7f8ce015e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 --2- 172.21.15.84:0/723853914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ce006b900 0x7f8ce0157640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 >> 172.21.15.84:0/723853914 conn(0x7f8ce00ce570 msgr2=0x7f8ce00ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 shutdown_connections 2024-04-14T10:58:18.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.516+0000 7f8ce7880640 1 -- 172.21.15.84:0/723853914 wait complete. 2024-04-14T10:58:18.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:58:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.630+0000 7f4516a08640 1 Processor -- start 2024-04-14T10:58:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.630+0000 7f4516a08640 1 -- start start 2024-04-14T10:58:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4516a08640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4510155130 0x7f45100cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4516a08640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45100b62e0 0x7f451015b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4516a08640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451015f2d0 con 0x7f45100cce20 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4516a08640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f45100b6720 con 0x7f45100b62e0 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4516a08640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f451015e470 con 0x7f4510155130 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4514fa5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45100b62e0 0x7f451015b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f450f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f45100cce20 0x7f45100cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48058/0 (socket says 172.21.15.84:48058) 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f450ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4510155130 0x7f45100cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4514fa5640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f45100b62e0 0x7f451015b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43392/0 (socket says 172.21.15.84:43392) 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f450f7fe640 1 -- 172.21.15.84:0/2434960637 learned_addr learned my addr 172.21.15.84:0/2434960637 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4514fa5640 1 -- 172.21.15.84:0/2434960637 >> v2:172.21.15.175:3300/0 conn(0x7f4510155130 msgr2=0x7f45100cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4514fa5640 1 --2- 172.21.15.84:0/2434960637 >> v2:172.21.15.175:3300/0 conn(0x7f4510155130 0x7f45100cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4514fa5640 1 -- 172.21.15.84:0/2434960637 >> v1:172.21.15.84:6789/0 conn(0x7f45100cce20 legacy=0x7f45100cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f4514fa5640 1 -- 172.21.15.84:0/2434960637 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451015e750 con 0x7f45100b62e0 2024-04-14T10:58:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f450effd640 1 -- 172.21.15.84:0/2434960637 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351643824 0 0) 0x7f451015f2d0 con 0x7f45100cce20 2024-04-14T10:58:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.631+0000 7f450ffff640 1 --2- 172.21.15.84:0/2434960637 >> v2:172.21.15.175:3300/0 conn(0x7f4510155130 0x7f45100cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4514fa5640 1 --2- 172.21.15.84:0/2434960637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45100b62e0 0x7f451015b170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4510073130 tx=0x7f450802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235b9e7b1a95681f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f450effd640 1 -- 172.21.15.84:0/2434960637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508039070 con 0x7f45100b62e0 2024-04-14T10:58:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f450effd640 1 -- 172.21.15.84:0/2434960637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450802cd00 con 0x7f45100b62e0 2024-04-14T10:58:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f450effd640 1 -- 172.21.15.84:0/2434960637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508034660 con 0x7f45100b62e0 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 -- 172.21.15.84:0/2434960637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45100b62e0 msgr2=0x7f451015b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 --2- 172.21.15.84:0/2434960637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45100b62e0 0x7f451015b170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4510073130 tx=0x7f450802bf50 comp rx=0 tx=0).stop 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 -- 172.21.15.84:0/2434960637 shutdown_connections 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 --2- 172.21.15.84:0/2434960637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f45100b62e0 0x7f451015b170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 --2- 172.21.15.84:0/2434960637 >> v2:172.21.15.175:3300/0 conn(0x7f4510155130 0x7f45100cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 -- 172.21.15.84:0/2434960637 >> 172.21.15.84:0/2434960637 conn(0x7f45100d07b0 msgr2=0x7f45100d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 -- 172.21.15.84:0/2434960637 shutdown_connections 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.632+0000 7f4516a08640 1 -- 172.21.15.84:0/2434960637 wait complete. 2024-04-14T10:58:18.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.633+0000 7f4516a08640 1 Processor -- start 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 -- start start 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45100b62e0 0x7f451015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45100cce20 0x7f45101569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 0x7f4510156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f451015eff0 con 0x7f4510155130 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f451015ed10 con 0x7f45100cce20 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4516a08640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4510155510 con 0x7f45100b62e0 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4514fa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 0x7f4510156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4514fa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 0x7f4510156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43408/0 (socket says 172.21.15.84:43408) 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.634+0000 7f4514fa5640 1 -- 172.21.15.84:0/2306684850 learned_addr learned my addr 172.21.15.84:0/2306684850 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f450f7fe640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45100cce20 0x7f45101569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f450ffff640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45100b62e0 0x7f451015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4514fa5640 1 -- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45100b62e0 msgr2=0x7f451015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4514fa5640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45100b62e0 0x7f451015d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4514fa5640 1 -- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45100cce20 msgr2=0x7f45101569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4514fa5640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45100cce20 0x7f45101569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4514fa5640 1 -- 172.21.15.84:0/2306684850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4510156460 con 0x7f4510155130 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4514fa5640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 0x7f4510156ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4508009e80 tx=0x7f4508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508039050 con 0x7f4510155130 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4508045070 con 0x7f4510155130 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451015ab60 con 0x7f4510155130 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508009450 con 0x7f4510155130 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.635+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4510159ae0 con 0x7f4510155130 2024-04-14T10:58:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.636+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4510069b20 con 0x7f4510155130 2024-04-14T10:58:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.637+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f450803e850 con 0x7f4510155130 2024-04-14T10:58:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.637+0000 7f450cff9640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f44fc06c920 0x7f44fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.637+0000 7f450ffff640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f44fc06c920 0x7f44fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.637+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f45080ae0f0 con 0x7f4510155130 2024-04-14T10:58:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.638+0000 7f450ffff640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f44fc06c920 0x7f44fc06ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4500009560 tx=0x7f4500009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.641+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f450804e020 con 0x7f4510155130 2024-04-14T10:58:18.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.818+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f45100cbf70 con 0x7f4510155130 2024-04-14T10:58:18.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.818+0000 7f450cff9640 1 -- 172.21.15.84:0/2306684850 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f450807bed0 con 0x7f4510155130 2024-04-14T10:58:18.817 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f44fc06c920 msgr2=0x7f44fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f44fc06c920 0x7f44fc06ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4500009560 tx=0x7f4500009190 comp rx=0 tx=0).stop 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 msgr2=0x7f4510156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 0x7f4510156ef0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4508009e80 tx=0x7f4508004a40 comp rx=0 tx=0).stop 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 shutdown_connections 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f44fc06c920 0x7f44fc06ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4510155130 0x7f4510156ef0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45100cce20 0x7f45101569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 --2- 172.21.15.84:0/2306684850 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45100b62e0 0x7f451015d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 >> 172.21.15.84:0/2306684850 conn(0x7f45100d07b0 msgr2=0x7f45100cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 shutdown_connections 2024-04-14T10:58:18.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.820+0000 7f4516a08640 1 -- 172.21.15.84:0/2306684850 wait complete. 2024-04-14T10:58:18.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:18.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.931+0000 7f91790ad640 1 Processor -- start 2024-04-14T10:58:18.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.931+0000 7f91790ad640 1 -- start start 2024-04-14T10:58:18.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f91790ad640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91741585d0 0x7f91740c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f91790ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f917415bdc0 0x7f917406e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f91790ad640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91740c85a0 0x7f917406e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f91790ad640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f91740c8ba0 con 0x7f91741585d0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f91790ad640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f91740c77a0 con 0x7f91740c85a0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f91790ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f91740c7a80 con 0x7f917415bdc0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91741585d0 0x7f91740c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f91741585d0 0x7f91740c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43416/0 (socket says 172.21.15.84:43416) 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 -- 172.21.15.84:0/3782304047 learned_addr learned my addr 172.21.15.84:0/3782304047 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f916bfff640 1 --2- 172.21.15.84:0/3782304047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f917415bdc0 0x7f917406e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f917359e640 1 --2- 172.21.15.84:0/3782304047 >> v2:172.21.15.175:3300/0 conn(0x7f91740c85a0 0x7f917406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 -- 172.21.15.84:0/3782304047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f917415bdc0 msgr2=0x7f917406e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 --2- 172.21.15.84:0/3782304047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f917415bdc0 0x7f917406e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 -- 172.21.15.84:0/3782304047 >> v2:172.21.15.175:3300/0 conn(0x7f91740c85a0 msgr2=0x7f917406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 --2- 172.21.15.84:0/3782304047 >> v2:172.21.15.175:3300/0 conn(0x7f91740c85a0 0x7f917406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.932+0000 7f9172d9d640 1 -- 172.21.15.84:0/3782304047 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91740c8df0 con 0x7f91741585d0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f9172d9d640 1 --2- 172.21.15.84:0/3782304047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91741585d0 0x7f91740c8060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9164009870 tx=0x7f916402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6151fe4119bd7d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f917259c640 1 -- 172.21.15.84:0/3782304047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640317c0 con 0x7f91741585d0 2024-04-14T10:58:18.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f917259c640 1 -- 172.21.15.84:0/3782304047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164037070 con 0x7f91741585d0 2024-04-14T10:58:18.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f917259c640 1 -- 172.21.15.84:0/3782304047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164031b80 con 0x7f91741585d0 2024-04-14T10:58:18.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 -- 172.21.15.84:0/3782304047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91741585d0 msgr2=0x7f91740c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 --2- 172.21.15.84:0/3782304047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91741585d0 0x7f91740c8060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9164009870 tx=0x7f916402b860 comp rx=0 tx=0).stop 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 -- 172.21.15.84:0/3782304047 shutdown_connections 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 --2- 172.21.15.84:0/3782304047 >> v2:172.21.15.175:3300/0 conn(0x7f91740c85a0 0x7f917406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 --2- 172.21.15.84:0/3782304047 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f917415bdc0 0x7f917406e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 --2- 172.21.15.84:0/3782304047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f91741585d0 0x7f91740c8060 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 -- 172.21.15.84:0/3782304047 >> 172.21.15.84:0/3782304047 conn(0x7f91740ccd20 msgr2=0x7f91740cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 -- 172.21.15.84:0/3782304047 shutdown_connections 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.933+0000 7f91790ad640 1 -- 172.21.15.84:0/3782304047 wait complete. 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 Processor -- start 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 -- start start 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91740c85a0 0x7f91741f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91741585d0 0x7f91740ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 0x7f917414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f91741589b0 con 0x7f917415bdc0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f91740c7440 con 0x7f91740c85a0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f91790ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f917415af50 con 0x7f91741585d0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f917359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 0x7f917414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f917359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 0x7f917414ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43418/0 (socket says 172.21.15.84:43418) 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f916bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91741585d0 0x7f91740ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.935+0000 7f917359e640 1 -- 172.21.15.84:0/1731295159 learned_addr learned my addr 172.21.15.84:0/1731295159 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f9172d9d640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91740c85a0 0x7f91741f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f917359e640 1 -- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91741585d0 msgr2=0x7f91740ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f917359e640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91741585d0 0x7f91740ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f917359e640 1 -- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91740c85a0 msgr2=0x7f91741f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f917359e640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91740c85a0 0x7f91741f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f917359e640 1 -- 172.21.15.84:0/1731295159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917415b230 con 0x7f917415bdc0 2024-04-14T10:58:18.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f917359e640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 0x7f917414ad60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f916c00ef00 tx=0x7f916c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c018020 con 0x7f917415bdc0 2024-04-14T10:58:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f916c014400 con 0x7f917415bdc0 2024-04-14T10:58:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917415b510 con 0x7f917415bdc0 2024-04-14T10:58:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c0147f0 con 0x7f917415bdc0 2024-04-14T10:58:18.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.936+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91741f11e0 con 0x7f917415bdc0 2024-04-14T10:58:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.937+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9174073fb0 con 0x7f917415bdc0 2024-04-14T10:58:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.938+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f916c005d10 con 0x7f917415bdc0 2024-04-14T10:58:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.938+0000 7f916b7fe640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f915406c920 0x7f915406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.938+0000 7f9172d9d640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f915406c920 0x7f915406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.938+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f916c08c380 con 0x7f917415bdc0 2024-04-14T10:58:18.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.938+0000 7f9172d9d640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f915406c920 0x7f915406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9164036000 tx=0x7f916403d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:18.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:18.942+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f9174073fb0 con 0x7f917415bdc0 2024-04-14T10:58:19.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.154+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9174069c30 con 0x7f917415bdc0 2024-04-14T10:58:19.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.155+0000 7f916b7fe640 1 -- 172.21.15.84:0/1731295159 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6866 (secure 0 0 0) 0x7f916c022030 con 0x7f917415bdc0 2024-04-14T10:58:19.154 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:19.154 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:15.245733+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308,4303]},"id":1}]} 2024-04-14T10:58:19.154 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.156+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f915406c920 msgr2=0x7f915406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f915406c920 0x7f915406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9164036000 tx=0x7f916403d040 comp rx=0 tx=0).stop 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 msgr2=0x7f917414ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 0x7f917414ad60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f916c00ef00 tx=0x7f916c00b480 comp rx=0 tx=0).stop 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 shutdown_connections 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f915406c920 0x7f915406ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f917415bdc0 0x7f917414ad60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f91741585d0 0x7f91740ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 --2- 172.21.15.84:0/1731295159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91740c85a0 0x7f91741f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 >> 172.21.15.84:0/1731295159 conn(0x7f91740ccd20 msgr2=0x7f9174154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 shutdown_connections 2024-04-14T10:58:19.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.157+0000 7f91790ad640 1 -- 172.21.15.84:0/1731295159 wait complete. 2024-04-14T10:58:19.166 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.268+0000 7fbb861c8640 1 Processor -- start 2024-04-14T10:58:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb861c8640 1 -- start start 2024-04-14T10:58:19.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb861c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb800b3930 0x7fbb8015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb861c8640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb800ccd90 con 0x7fbb8015b500 2024-04-14T10:58:19.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb861c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8015e4d0 con 0x7fbb80155160 2024-04-14T10:58:19.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb861c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8015b990 con 0x7fbb800b3930 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb7ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbb8015b500 0x7fbb800cc150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48064/0 (socket says 172.21.15.84:48064) 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb7ffff640 1 -- 172.21.15.84:0/3263686927 learned_addr learned my addr 172.21.15.84:0/3263686927 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.269+0000 7fbb7effd640 1 --2- 172.21.15.84:0/3263686927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb800b3930 0x7fbb8015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371024768 0 0) 0x7fbb800ccd90 con 0x7fbb8015b500 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb6c003520 con 0x7fbb8015b500 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199850094 0 0) 0x7fbb8015e4d0 con 0x7fbb80155160 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb800ccd90 con 0x7fbb80155160 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7effd640 1 -- 172.21.15.84:0/3263686927 >> v1:172.21.15.175:6789/0 conn(0x7fbb80155160 legacy=0x7fbb800cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7effd640 1 -- 172.21.15.84:0/3263686927 >> v1:172.21.15.84:6789/0 conn(0x7fbb8015b500 legacy=0x7fbb800cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.270+0000 7fbb7effd640 1 -- 172.21.15.84:0/3263686927 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8015e7b0 con 0x7fbb800b3930 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb7effd640 1 --2- 172.21.15.84:0/3263686927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb800b3930 0x7fbb8015afc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb680097d0 tx=0x7fbb6802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710f4f5c840b0274 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68034070 con 0x7fbb800b3930 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb68030880 con 0x7fbb800b3930 2024-04-14T10:58:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb7e7fc640 1 -- 172.21.15.84:0/3263686927 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68030c50 con 0x7fbb800b3930 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 -- 172.21.15.84:0/3263686927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb800b3930 msgr2=0x7fbb8015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 --2- 172.21.15.84:0/3263686927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb800b3930 0x7fbb8015afc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbb680097d0 tx=0x7fbb6802b9c0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 -- 172.21.15.84:0/3263686927 shutdown_connections 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 --2- 172.21.15.84:0/3263686927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb800b3930 0x7fbb8015afc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 -- 172.21.15.84:0/3263686927 >> 172.21.15.84:0/3263686927 conn(0x7fbb8006b900 msgr2=0x7fbb8006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 -- 172.21.15.84:0/3263686927 shutdown_connections 2024-04-14T10:58:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.271+0000 7fbb861c8640 1 -- 172.21.15.84:0/3263686927 wait complete. 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.272+0000 7fbb861c8640 1 Processor -- start 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 -- start start 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 0x7fbb800c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb80155160 0x7fbb800d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb8015b500 0x7fbb80155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8015f050 con 0x7fbb800b3930 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8015ed70 con 0x7fbb80155160 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb861c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb80155540 con 0x7fbb8015b500 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb7f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 0x7fbb800c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb7f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 0x7fbb800c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43428/0 (socket says 172.21.15.84:43428) 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/4240658115 learned_addr learned my addr 172.21.15.84:0/4240658115 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb7effd640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb80155160 0x7fbb800d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.273+0000 7fbb7ffff640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb8015b500 0x7fbb80155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb8015b500 msgr2=0x7fbb80155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb8015b500 0x7fbb80155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb80155160 msgr2=0x7fbb800d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb80155160 0x7fbb800d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb7f7fe640 1 -- 172.21.15.84:0/4240658115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb801f0b00 con 0x7fbb800b3930 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb7f7fe640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 0x7fbb800c8c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c530 tx=0x7fbb7000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb700052d0 con 0x7fbb800b3930 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb70005490 con 0x7fbb800b3930 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb801f0dc0 con 0x7fbb800b3930 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70012870 con 0x7fbb800b3930 2024-04-14T10:58:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.274+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb801f1380 con 0x7fbb800b3930 2024-04-14T10:58:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.275+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb80069c30 con 0x7fbb800b3930 2024-04-14T10:58:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.275+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb70012a10 con 0x7fbb800b3930 2024-04-14T10:58:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.276+0000 7fbb77fff640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbb6006c8f0 0x7fbb6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.276+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbb7008b730 con 0x7fbb800b3930 2024-04-14T10:58:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.276+0000 7fbb7effd640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbb6006c8f0 0x7fbb6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.276+0000 7fbb7effd640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbb6006c8f0 0x7fbb6006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036000 tx=0x7fbb6803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.280+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fbb70059490 con 0x7fbb800b3930 2024-04-14T10:58:19.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.459+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb800cbf30 con 0x7fbb800b3930 2024-04-14T10:58:19.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.460+0000 7fbb77fff640 1 -- 172.21.15.84:0/4240658115 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fbb7005d790 con 0x7fbb800b3930 2024-04-14T10:58:19.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:19.459 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:19.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbb6006c8f0 msgr2=0x7fbb6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbb6006c8f0 0x7fbb6006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036000 tx=0x7fbb6803b040 comp rx=0 tx=0).stop 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 msgr2=0x7fbb800c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 0x7fbb800c8c10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000c530 tx=0x7fbb7000c9f0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 shutdown_connections 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbb6006c8f0 0x7fbb6006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb8015b500 0x7fbb80155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb80155160 0x7fbb800d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 --2- 172.21.15.84:0/4240658115 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb800b3930 0x7fbb800c8c10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 >> 172.21.15.84:0/4240658115 conn(0x7fbb8006b900 msgr2=0x7fbb800cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 shutdown_connections 2024-04-14T10:58:19.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.462+0000 7fbb861c8640 1 -- 172.21.15.84:0/4240658115 wait complete. 2024-04-14T10:58:19.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:58:19.473 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:58:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.577+0000 7f2fcfede640 1 Processor -- start 2024-04-14T10:58:19.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.577+0000 7f2fcfede640 1 -- start start 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcfede640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fc8155130 0x7f2fc80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcfede640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc815f2d0 con 0x7f2fc80b62e0 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcfede640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc80b6720 con 0x7f2fc80cce20 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcfede640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc815e470 con 0x7f2fc8155130 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcdc7a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fc8155130 0x7f2fc80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fce47b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2fc80b62e0 0x7f2fc815b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48080/0 (socket says 172.21.15.84:48080) 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcdc7a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2fc8155130 0x7f2fc80cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43434/0 (socket says 172.21.15.84:43434) 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fce47b640 1 -- 172.21.15.84:0/1401300197 learned_addr learned my addr 172.21.15.84:0/1401300197 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:19.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/1401300197 >> v1:172.21.15.175:6789/0 conn(0x7f2fc80cce20 legacy=0x7f2fc80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/1401300197 >> v1:172.21.15.84:6789/0 conn(0x7f2fc80b62e0 legacy=0x7f2fc815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/1401300197 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc815e750 con 0x7f2fc8155130 2024-04-14T10:58:19.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.578+0000 7f2fccc78640 1 -- 172.21.15.84:0/1401300197 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017298545 0 0) 0x7f2fc815f2d0 con 0x7f2fc80b62e0 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.579+0000 7f2fcdc7a640 1 --2- 172.21.15.84:0/1401300197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc8155130 0x7f2fc80cc190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097a0 tx=0x7f2fc402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52df84c855c465c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.579+0000 7f2fccc78640 1 -- 172.21.15.84:0/1401300197 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402f810 con 0x7f2fc8155130 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.579+0000 7f2fccc78640 1 -- 172.21.15.84:0/1401300197 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc402f9b0 con 0x7f2fc8155130 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.579+0000 7f2fccc78640 1 -- 172.21.15.84:0/1401300197 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402fd80 con 0x7f2fc8155130 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 -- 172.21.15.84:0/1401300197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc8155130 msgr2=0x7f2fc80cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 --2- 172.21.15.84:0/1401300197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc8155130 0x7f2fc80cc190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097a0 tx=0x7f2fc402b9f0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 -- 172.21.15.84:0/1401300197 shutdown_connections 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 --2- 172.21.15.84:0/1401300197 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc8155130 0x7f2fc80cc190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 -- 172.21.15.84:0/1401300197 >> 172.21.15.84:0/1401300197 conn(0x7f2fc80d07b0 msgr2=0x7f2fc80d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:19.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 -- 172.21.15.84:0/1401300197 shutdown_connections 2024-04-14T10:58:19.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.580+0000 7f2fcfede640 1 -- 172.21.15.84:0/1401300197 wait complete. 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.581+0000 7f2fcfede640 1 Processor -- start 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.581+0000 7f2fcfede640 1 -- start start 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 0x7f2fc81e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc80cce20 0x7f2fc8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc8155130 0x7f2fc81f1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc815eff0 con 0x7f2fc80b62e0 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc815ed10 con 0x7f2fc8155130 2024-04-14T10:58:19.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc8155510 con 0x7f2fc80cce20 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 0x7f2fc81e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 0x7f2fc81e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43450/0 (socket says 172.21.15.84:43450) 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/4038082914 learned_addr learned my addr 172.21.15.84:0/4038082914 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcd479640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc80cce20 0x7f2fc8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fce47b640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc8155130 0x7f2fc81f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc80cce20 msgr2=0x7f2fc8159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc80cce20 0x7f2fc8159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc8155130 msgr2=0x7f2fc81f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc8155130 0x7f2fc81f1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 -- 172.21.15.84:0/4038082914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc81f44c0 con 0x7f2fc80b62e0 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcdc7a640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 0x7f2fc81e6e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4046070 con 0x7f2fc80b62e0 2024-04-14T10:58:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc4037c40 con 0x7f2fc80b62e0 2024-04-14T10:58:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc81f4780 con 0x7f2fc80b62e0 2024-04-14T10:58:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc402fe60 con 0x7f2fc80b62e0 2024-04-14T10:58:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.582+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc81f4d40 con 0x7f2fc80b62e0 2024-04-14T10:58:19.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.583+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc8069b20 con 0x7f2fc80b62e0 2024-04-14T10:58:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.584+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fc4049070 con 0x7f2fc80b62e0 2024-04-14T10:58:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.584+0000 7f2fbe7fc640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2fac06c8f0 0x7f2fac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.584+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2fc40ad1f0 con 0x7f2fc80b62e0 2024-04-14T10:58:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.584+0000 7f2fcd479640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2fac06c8f0 0x7f2fac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.585+0000 7f2fcd479640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2fac06c8f0 0x7f2fac06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8154900 tx=0x7f2fb8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.588+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f2fc403e070 con 0x7f2fc80b62e0 2024-04-14T10:58:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.763+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fc80cbac0 con 0x7f2fc80b62e0 2024-04-14T10:58:19.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.763+0000 7f2fbe7fc640 1 -- 172.21.15.84:0/4038082914 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2fc4033030 con 0x7f2fc80b62e0 2024-04-14T10:58:19.762 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2fac06c8f0 msgr2=0x7f2fac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2fac06c8f0 0x7f2fac06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8154900 tx=0x7f2fb8009040 comp rx=0 tx=0).stop 2024-04-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 msgr2=0x7f2fc81e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 0x7f2fc81e6e40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc40046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 shutdown_connections 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2fac06c8f0 0x7f2fac06edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc8155130 0x7f2fc81f1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc80cce20 0x7f2fc8159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 --2- 172.21.15.84:0/4038082914 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2fc80b62e0 0x7f2fc81e6e40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 >> 172.21.15.84:0/4038082914 conn(0x7f2fc80d07b0 msgr2=0x7f2fc80c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 shutdown_connections 2024-04-14T10:58:19.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.765+0000 7f2fcfede640 1 -- 172.21.15.84:0/4038082914 wait complete. 2024-04-14T10:58:19.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:58:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.878+0000 7fc820f7b640 1 Processor -- start 2024-04-14T10:58:19.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.878+0000 7fc820f7b640 1 -- start start 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc820f7b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc81c06c270 0x7fc81c06c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc820f7b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc81c0703d0 0x7fc81c15edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc820f7b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06b900 0x7fc81c0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc820f7b640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc81c15f2f0 con 0x7fc81c0703d0 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc820f7b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc81c0c8f70 con 0x7fc81c06c270 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc820f7b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc81c0c9230 con 0x7fc81c06b900 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc819d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc81c0703d0 0x7fc81c15edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc819d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc81c0703d0 0x7fc81c15edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43458/0 (socket says 172.21.15.84:43458) 2024-04-14T10:58:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc819d9b640 1 -- 172.21.15.84:0/715172419 learned_addr learned my addr 172.21.15.84:0/715172419 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc81a59c640 1 --2- 172.21.15.84:0/715172419 >> v2:172.21.15.175:3300/0 conn(0x7fc81c06c270 0x7fc81c06c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.879+0000 7fc81ad9d640 1 --2- 172.21.15.84:0/715172419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06b900 0x7fc81c0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc819d9b640 1 -- 172.21.15.84:0/715172419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06b900 msgr2=0x7fc81c0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc819d9b640 1 --2- 172.21.15.84:0/715172419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06b900 0x7fc81c0c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc819d9b640 1 -- 172.21.15.84:0/715172419 >> v2:172.21.15.175:3300/0 conn(0x7fc81c06c270 msgr2=0x7fc81c06c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc819d9b640 1 --2- 172.21.15.84:0/715172419 >> v2:172.21.15.175:3300/0 conn(0x7fc81c06c270 0x7fc81c06c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc819d9b640 1 -- 172.21.15.84:0/715172419 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c0c9510 con 0x7fc81c0703d0 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc81a59c640 1 --2- 172.21.15.84:0/715172419 >> v2:172.21.15.175:3300/0 conn(0x7fc81c06c270 0x7fc81c06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc819d9b640 1 --2- 172.21.15.84:0/715172419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c15edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc81c071160 tx=0x7fc81002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e56010327622ad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.880+0000 7fc81959a640 1 -- 172.21.15.84:0/715172419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810035020 con 0x7fc81c0703d0 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc81959a640 1 -- 172.21.15.84:0/715172419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc810031870 con 0x7fc81c0703d0 2024-04-14T10:58:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc81959a640 1 -- 172.21.15.84:0/715172419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810031c40 con 0x7fc81c0703d0 2024-04-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 -- 172.21.15.84:0/715172419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 msgr2=0x7fc81c15edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 --2- 172.21.15.84:0/715172419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c15edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc81c071160 tx=0x7fc81002b910 comp rx=0 tx=0).stop 2024-04-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 -- 172.21.15.84:0/715172419 shutdown_connections 2024-04-14T10:58:19.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 --2- 172.21.15.84:0/715172419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06b900 0x7fc81c0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 --2- 172.21.15.84:0/715172419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c15edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 --2- 172.21.15.84:0/715172419 >> v2:172.21.15.175:3300/0 conn(0x7fc81c06c270 0x7fc81c06c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 -- 172.21.15.84:0/715172419 >> 172.21.15.84:0/715172419 conn(0x7fc81c0ce570 msgr2=0x7fc81c0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 -- 172.21.15.84:0/715172419 shutdown_connections 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.881+0000 7fc820f7b640 1 -- 172.21.15.84:0/715172419 wait complete. 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.882+0000 7fc820f7b640 1 Processor -- start 2024-04-14T10:58:19.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.882+0000 7fc820f7b640 1 -- start start 2024-04-14T10:58:19.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc820f7b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc81c06b900 0x7fc81c1f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc820f7b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06c270 0x7fc81c1e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc820f7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c1f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc820f7b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c06feb0 con 0x7fc81c0703d0 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc820f7b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc81c06fbd0 con 0x7fc81c06b900 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc820f7b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc81c0c4500 con 0x7fc81c06c270 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc81ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c1f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc81ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c1f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43462/0 (socket says 172.21.15.84:43462) 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc81ad9d640 1 -- 172.21.15.84:0/1180824751 learned_addr learned my addr 172.21.15.84:0/1180824751 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc81a59c640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc81c06b900 0x7fc81c1f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.883+0000 7fc819d9b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06c270 0x7fc81c1e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81ad9d640 1 -- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06c270 msgr2=0x7fc81c1e6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81ad9d640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06c270 0x7fc81c1e6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81ad9d640 1 -- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc81c06b900 msgr2=0x7fc81c1f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81ad9d640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc81c06b900 0x7fc81c1f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81ad9d640 1 -- 172.21.15.84:0/1180824751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c1f4ae0 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81a59c640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc81c06b900 0x7fc81c1f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc81ad9d640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c1f45a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc81400e780 tx=0x7fc81400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814017070 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81400c730 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81c157730 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81400cb20 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.884+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81c157cf0 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.885+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81c069b20 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.885+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc81401a070 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.886+0000 7fc80affd640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7fc06c8f0 0x7fc7fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.886+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc81408bd30 con 0x7fc81c0703d0 2024-04-14T10:58:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.886+0000 7fc81a59c640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7fc06c8f0 0x7fc7fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.886+0000 7fc81a59c640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7fc06c8f0 0x7fc7fc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009fd0 tx=0x7fc80c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:19.890+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc814059b10 con 0x7fc81c0703d0 2024-04-14T10:58:20.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.063+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc81c0c98a0 con 0x7fc81c0703d0 2024-04-14T10:58:20.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.063+0000 7fc80affd640 1 -- 172.21.15.84:0/1180824751 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fc81405de10 con 0x7fc81c0703d0 2024-04-14T10:58:20.062 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7fc06c8f0 msgr2=0x7fc7fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7fc06c8f0 0x7fc7fc06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009fd0 tx=0x7fc80c00b040 comp rx=0 tx=0).stop 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 msgr2=0x7fc81c1f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c1f45a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc81400e780 tx=0x7fc81400ec40 comp rx=0 tx=0).stop 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 shutdown_connections 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7fc06c8f0 0x7fc7fc06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc81c0703d0 0x7fc81c1f45a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc81c06c270 0x7fc81c1e6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 --2- 172.21.15.84:0/1180824751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc81c06b900 0x7fc81c1f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 >> 172.21.15.84:0/1180824751 conn(0x7fc81c0ce570 msgr2=0x7fc81c0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 shutdown_connections 2024-04-14T10:58:20.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.065+0000 7fc820f7b640 1 -- 172.21.15.84:0/1180824751 wait complete. 2024-04-14T10:58:20.074 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:58:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.178+0000 7fb6f4cc8640 1 Processor -- start 2024-04-14T10:58:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.178+0000 7fb6f4cc8640 1 -- start start 2024-04-14T10:58:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6f4cc8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f01584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6f4cc8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb6f006b900 0x7fb6f0072990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6f4cc8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6f00c7120 0x7fb6f0072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6f4cc8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fb6f00c4970 con 0x7fb6f00c7120 2024-04-14T10:58:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6f4cc8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb6f0158a30 con 0x7fb6f006b900 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6f4cc8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f00c4bc0 con 0x7fb6f0151e20 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.179+0000 7fb6eed9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6f00c7120 0x7fb6f0072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fb6f00c7120 0x7fb6f0072ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43466/0 (socket says 172.21.15.84:43466) 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 -- 172.21.15.84:0/2892315302 learned_addr learned my addr 172.21.15.84:0/2892315302 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6ee59c640 1 --2- 172.21.15.84:0/2892315302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f01584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6edd9b640 1 --2- 172.21.15.84:0/2892315302 >> v2:172.21.15.175:3300/0 conn(0x7fb6f006b900 0x7fb6f0072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 -- 172.21.15.84:0/2892315302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 msgr2=0x7fb6f01584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 --2- 172.21.15.84:0/2892315302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f01584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 -- 172.21.15.84:0/2892315302 >> v2:172.21.15.175:3300/0 conn(0x7fb6f006b900 msgr2=0x7fb6f0072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 --2- 172.21.15.84:0/2892315302 >> v2:172.21.15.175:3300/0 conn(0x7fb6f006b900 0x7fb6f0072990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 -- 172.21.15.84:0/2892315302 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f00c4ea0 con 0x7fb6f00c7120 2024-04-14T10:58:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.180+0000 7fb6eed9d640 1 --2- 172.21.15.84:0/2892315302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f0072ed0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0071ce0 tx=0x7fb6e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b309aebbb55f6f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6ed59a640 1 -- 172.21.15.84:0/2892315302 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8035020 con 0x7fb6f00c7120 2024-04-14T10:58:20.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6ed59a640 1 -- 172.21.15.84:0/2892315302 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e8031870 con 0x7fb6f00c7120 2024-04-14T10:58:20.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6ed59a640 1 -- 172.21.15.84:0/2892315302 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8031c40 con 0x7fb6f00c7120 2024-04-14T10:58:20.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/2892315302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 msgr2=0x7fb6f0072ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/2892315302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f0072ed0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0071ce0 tx=0x7fb6e802b910 comp rx=0 tx=0).stop 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/2892315302 shutdown_connections 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/2892315302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f0072ed0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/2892315302 >> v2:172.21.15.175:3300/0 conn(0x7fb6f006b900 0x7fb6f0072990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/2892315302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f01584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/2892315302 >> 172.21.15.84:0/2892315302 conn(0x7fb6f00c9f70 msgr2=0x7fb6f00ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/2892315302 shutdown_connections 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.181+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/2892315302 wait complete. 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.182+0000 7fb6f4cc8640 1 Processor -- start 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 -- start start 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6f006b900 0x7fb6f01ed950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f00c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0152200 con 0x7fb6f00c7120 2024-04-14T10:58:20.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f0157fd0 con 0x7fb6f006b900 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6f4cc8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f006cdf0 con 0x7fb6f0151e20 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6edd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6edd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f014d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43472/0 (socket says 172.21.15.84:43472) 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6edd9b640 1 -- 172.21.15.84:0/949431000 learned_addr learned my addr 172.21.15.84:0/949431000 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6eed9d640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f00c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.183+0000 7fb6ee59c640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6f006b900 0x7fb6f01ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6edd9b640 1 -- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 msgr2=0x7fb6f00c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6edd9b640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f00c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6edd9b640 1 -- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6f006b900 msgr2=0x7fb6f01ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6edd9b640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6f006b900 0x7fb6f01ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6edd9b640 1 -- 172.21.15.84:0/949431000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f014c600 con 0x7fb6f00c7120 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6edd9b640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f014d980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400e840 tx=0x7fb6e400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4017070 con 0x7fb6f00c7120 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e400c730 con 0x7fb6f00c7120 2024-04-14T10:58:20.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f014c8e0 con 0x7fb6f00c7120 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e400cb20 con 0x7fb6f00c7120 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.184+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f014cea0 con 0x7fb6f00c7120 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.185+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f0069b20 con 0x7fb6f00c7120 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.185+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6e401a070 con 0x7fb6f00c7120 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.186+0000 7fb6deffd640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb6d006c8f0 0x7fb6d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.186+0000 7fb6ee59c640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb6d006c8f0 0x7fb6d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.186+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb6e408bd20 con 0x7fb6f00c7120 2024-04-14T10:58:20.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.186+0000 7fb6ee59c640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb6d006c8f0 0x7fb6d006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00113e0 tx=0x7fb6e000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.190+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fb6e4059a70 con 0x7fb6f00c7120 2024-04-14T10:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.371+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb6f0073a70 con 0x7fb6f00c7120 2024-04-14T10:58:20.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.371+0000 7fb6deffd640 1 -- 172.21.15.84:0/949431000 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fb6e405dd70 con 0x7fb6f00c7120 2024-04-14T10:58:20.370 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T10:58:20.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb6d006c8f0 msgr2=0x7fb6d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb6d006c8f0 0x7fb6d006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00113e0 tx=0x7fb6e000b040 comp rx=0 tx=0).stop 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 msgr2=0x7fb6f014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f014d980 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400e840 tx=0x7fb6e400ed00 comp rx=0 tx=0).stop 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 shutdown_connections 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fb6d006c8f0 0x7fb6d006edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6f0151e20 0x7fb6f00c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6f00c7120 0x7fb6f014d980 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 --2- 172.21.15.84:0/949431000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6f006b900 0x7fb6f01ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 >> 172.21.15.84:0/949431000 conn(0x7fb6f00c9f70 msgr2=0x7fb6f00c6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 shutdown_connections 2024-04-14T10:58:20.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.373+0000 7fb6f4cc8640 1 -- 172.21.15.84:0/949431000 wait complete. 2024-04-14T10:58:20.383 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.484+0000 7f4dc09aa640 1 Processor -- start 2024-04-14T10:58:20.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.484+0000 7f4dc09aa640 1 -- start start 2024-04-14T10:58:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4dc09aa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4dbc155160 0x7f4dbc0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4dc09aa640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4dbc0b3930 0x7f4dbc0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4dc09aa640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dbc0ccd90 con 0x7f4dbc15afc0 2024-04-14T10:58:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4dc09aa640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f4dbc15e4d0 con 0x7f4dbc0b3930 2024-04-14T10:58:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4dc09aa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4dbc15e7b0 con 0x7f4dbc155160 2024-04-14T10:58:20.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4dbc0b3930 0x7f4dbc0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f4dbc0b3930 0x7f4dbc0cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43482/0 (socket says 172.21.15.84:43482) 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4dbad9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4dbc15afc0 0x7f4dbc15b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48088/0 (socket says 172.21.15.84:48088) 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 -- 172.21.15.84:0/3472557037 learned_addr learned my addr 172.21.15.84:0/3472557037 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 -- 172.21.15.84:0/3472557037 >> v2:172.21.15.175:3300/0 conn(0x7f4dbc155160 msgr2=0x7f4dbc0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 --2- 172.21.15.84:0/3472557037 >> v2:172.21.15.175:3300/0 conn(0x7f4dbc155160 0x7f4dbc0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 -- 172.21.15.84:0/3472557037 >> v1:172.21.15.84:6789/0 conn(0x7f4dbc15afc0 legacy=0x7f4dbc15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db9d9b640 1 -- 172.21.15.84:0/3472557037 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc15ea90 con 0x7f4dbc0b3930 2024-04-14T10:58:20.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.485+0000 7f4db959a640 1 -- 172.21.15.84:0/3472557037 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108375912 0 0) 0x7f4dbc0ccd90 con 0x7f4dbc15afc0 2024-04-14T10:58:20.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.486+0000 7f4db9d9b640 1 --2- 172.21.15.84:0/3472557037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc0b3930 0x7f4dbc0cb910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc08e060 tx=0x7f4db002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4dd1273c85b262f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.486+0000 7f4db959a640 1 -- 172.21.15.84:0/3472557037 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db002f850 con 0x7f4dbc0b3930 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.486+0000 7f4db959a640 1 -- 172.21.15.84:0/3472557037 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db002f9f0 con 0x7f4dbc0b3930 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.486+0000 7f4db959a640 1 -- 172.21.15.84:0/3472557037 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db002fdc0 con 0x7f4dbc0b3930 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3472557037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc0b3930 msgr2=0x7f4dbc0cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3472557037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc0b3930 0x7f4dbc0cb910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc08e060 tx=0x7f4db002ba30 comp rx=0 tx=0).stop 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3472557037 shutdown_connections 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3472557037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc0b3930 0x7f4dbc0cb910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3472557037 >> v2:172.21.15.175:3300/0 conn(0x7f4dbc155160 0x7f4dbc0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3472557037 >> 172.21.15.84:0/3472557037 conn(0x7f4dbc06b900 msgr2=0x7f4dbc06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3472557037 shutdown_connections 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.487+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3472557037 wait complete. 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.488+0000 7f4dc09aa640 1 Processor -- start 2024-04-14T10:58:20.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.488+0000 7f4dc09aa640 1 -- start start 2024-04-14T10:58:20.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dbc0b3930 0x7f4dbc153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dbc155160 0x7f4dbc0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 0x7f4dbc155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc155540 con 0x7f4dbc15afc0 2024-04-14T10:58:20.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc15f050 con 0x7f4dbc155160 2024-04-14T10:58:20.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4dbc0cc150 con 0x7f4dbc0b3930 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 0x7f4dbc155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 0x7f4dbc155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43488/0 (socket says 172.21.15.84:43488) 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 -- 172.21.15.84:0/3684547332 learned_addr learned my addr 172.21.15.84:0/3684547332 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dba59c640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dbc0b3930 0x7f4dbc153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4db9d9b640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dbc155160 0x7f4dbc0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 -- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dbc0b3930 msgr2=0x7f4dbc153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dbc0b3930 0x7f4dbc153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 -- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dbc155160 msgr2=0x7f4dbc0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dbc155160 0x7f4dbc0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 -- 172.21.15.84:0/3684547332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc153ff0 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dbad9d640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 0x7f4dbc155810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c780 tx=0x7f4db400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4018070 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db4004d80 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.489+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dbc1542d0 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.490+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db400a820 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.490+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc154890 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.490+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dbc069c30 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.491+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4db401b070 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.491+0000 7f4daaffd640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.491+0000 7f4dba59c640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.491+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4db408aea0 con 0x7f4dbc15afc0 2024-04-14T10:58:20.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.492+0000 7f4dba59c640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009990 tx=0x7f4dac009110 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.496+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f4db4058c80 con 0x7f4dbc15afc0 2024-04-14T10:58:20.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.707+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dbc0cbf30 con 0x7f4dbc15afc0 2024-04-14T10:58:20.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.708+0000 7f4daaffd640 1 -- 172.21.15.84:0/3684547332 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6866 (secure 0 0 0) 0x7f4db405cf80 con 0x7f4dbc15afc0 2024-04-14T10:58:20.707 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:20.707 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:15.245733+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4308,4303]},"id":1}]} 2024-04-14T10:58:20.707 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-04-14T10:58:20.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4d9c06c8f0 msgr2=0x7f4d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009990 tx=0x7f4dac009110 comp rx=0 tx=0).stop 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 msgr2=0x7f4dbc155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 0x7f4dbc155810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c780 tx=0x7f4db400cb80 comp rx=0 tx=0).stop 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 shutdown_connections 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4d9c06c8f0 0x7f4d9c06edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4dbc15afc0 0x7f4dbc155810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4dbc155160 0x7f4dbc0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 --2- 172.21.15.84:0/3684547332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4dbc0b3930 0x7f4dbc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 >> 172.21.15.84:0/3684547332 conn(0x7f4dbc06b900 msgr2=0x7f4dbc0caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 shutdown_connections 2024-04-14T10:58:20.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.710+0000 7f4dc09aa640 1 -- 172.21.15.84:0/3684547332 wait complete. 2024-04-14T10:58:20.719 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:20.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.820+0000 7f292ffed640 1 Processor -- start 2024-04-14T10:58:20.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.820+0000 7f292ffed640 1 -- start start 2024-04-14T10:58:20.819 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292ffed640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f292815cdf0 0x7f29280ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292ffed640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2928070200 con 0x7f29281551d0 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292ffed640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292815acd0 con 0x7f29280ce320 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292ffed640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f292815af70 con 0x7f292815cdf0 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292e58a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f292815cdf0 0x7f29280ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292dd89640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f29281551d0 0x7f292806faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48098/0 (socket says 172.21.15.84:48098) 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292dd89640 1 -- 172.21.15.84:0/2526558137 learned_addr learned my addr 172.21.15.84:0/2526558137 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292e58a640 1 --2- 172.21.15.84:0/2526558137 >> v2:172.21.15.84:3300/0 conn(0x7f292815cdf0 0x7f29280ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43498/0 (socket says 172.21.15.84:43498) 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292e58a640 1 -- 172.21.15.84:0/2526558137 >> v1:172.21.15.175:6789/0 conn(0x7f29280ce320 legacy=0x7f292815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292e58a640 1 -- 172.21.15.84:0/2526558137 >> v1:172.21.15.84:6789/0 conn(0x7f29281551d0 legacy=0x7f292806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.821+0000 7f292e58a640 1 -- 172.21.15.84:0/2526558137 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292815b210 con 0x7f292815cdf0 2024-04-14T10:58:20.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.822+0000 7f292e58a640 1 --2- 172.21.15.84:0/2526558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f292815cdf0 0x7f29280ce750 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2920009d90 tx=0x7f292002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fcd4465db7d232 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.822+0000 7f292cd87640 1 -- 172.21.15.84:0/2526558137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920039070 con 0x7f292815cdf0 2024-04-14T10:58:20.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.822+0000 7f292cd87640 1 -- 172.21.15.84:0/2526558137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292002cd00 con 0x7f292815cdf0 2024-04-14T10:58:20.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.822+0000 7f292cd87640 1 -- 172.21.15.84:0/2526558137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2920034660 con 0x7f292815cdf0 2024-04-14T10:58:20.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.822+0000 7f292ffed640 1 -- 172.21.15.84:0/2526558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f292815cdf0 msgr2=0x7f29280ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.822+0000 7f292ffed640 1 --2- 172.21.15.84:0/2526558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f292815cdf0 0x7f29280ce750 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2920009d90 tx=0x7f292002bf50 comp rx=0 tx=0).stop 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.823+0000 7f292ffed640 1 -- 172.21.15.84:0/2526558137 shutdown_connections 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.823+0000 7f292ffed640 1 --2- 172.21.15.84:0/2526558137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f292815cdf0 0x7f29280ce750 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.823+0000 7f292ffed640 1 -- 172.21.15.84:0/2526558137 >> 172.21.15.84:0/2526558137 conn(0x7f292806db10 msgr2=0x7f292806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.823+0000 7f292ffed640 1 -- 172.21.15.84:0/2526558137 shutdown_connections 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.823+0000 7f292ffed640 1 -- 172.21.15.84:0/2526558137 wait complete. 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 Processor -- start 2024-04-14T10:58:20.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 -- start start 2024-04-14T10:58:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29280ce320 0x7f29281f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 0x7f29281f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f292815cdf0 0x7f292814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f292815bab0 con 0x7f29281551d0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f292815b7d0 con 0x7f292815cdf0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292ffed640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f292815c1c0 con 0x7f29280ce320 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292d588640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 0x7f29281f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292d588640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 0x7f29281f47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43502/0 (socket says 172.21.15.84:43502) 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.824+0000 7f292d588640 1 -- 172.21.15.84:0/1328725387 learned_addr learned my addr 172.21.15.84:0/1328725387 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292e58a640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f292815cdf0 0x7f292814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292dd89640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29280ce320 0x7f29281f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292d588640 1 -- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29280ce320 msgr2=0x7f29281f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292d588640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29280ce320 0x7f29281f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292d588640 1 -- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f292815cdf0 msgr2=0x7f292814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292d588640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f292815cdf0 0x7f292814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292d588640 1 -- 172.21.15.84:0/1328725387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29280ca9a0 con 0x7f29281551d0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292e58a640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f292815cdf0 0x7f292814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292d588640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 0x7f29281f47c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f291800b3f0 tx=0x7f291800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918015020 con 0x7f29281551d0 2024-04-14T10:58:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2918011830 con 0x7f29281551d0 2024-04-14T10:58:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29280cac80 con 0x7f29281551d0 2024-04-14T10:58:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918011c20 con 0x7f29281551d0 2024-04-14T10:58:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.825+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29281f3fc0 con 0x7f29281551d0 2024-04-14T10:58:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.826+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2928069c30 con 0x7f29281551d0 2024-04-14T10:58:20.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.826+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2918018020 con 0x7f29281551d0 2024-04-14T10:58:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.827+0000 7f291e7fc640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f290c06c8f0 0x7f290c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.827+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f291808ba70 con 0x7f29281551d0 2024-04-14T10:58:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.827+0000 7f292dd89640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f290c06c8f0 0x7f290c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:20.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.827+0000 7f292dd89640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f290c06c8f0 0x7f290c06edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2924000f60 tx=0x7f2924009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:20.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:20.831+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f291801f020 con 0x7f29281551d0 2024-04-14T10:58:21.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.007+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f292806f8b0 con 0x7f29281551d0 2024-04-14T10:58:21.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.008+0000 7f291e7fc640 1 -- 172.21.15.84:0/1328725387 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f29180172c0 con 0x7f29281551d0 2024-04-14T10:58:21.007 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:21.007 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:21.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f290c06c8f0 msgr2=0x7f290c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f290c06c8f0 0x7f290c06edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2924000f60 tx=0x7f2924009040 comp rx=0 tx=0).stop 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 msgr2=0x7f29281f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 0x7f29281f47c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f291800b3f0 tx=0x7f291800b8b0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 shutdown_connections 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f290c06c8f0 0x7f290c06edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f292815cdf0 0x7f292814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29281551d0 0x7f29281f47c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 --2- 172.21.15.84:0/1328725387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f29280ce320 0x7f29281f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 >> 172.21.15.84:0/1328725387 conn(0x7f292806db10 msgr2=0x7f292806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 shutdown_connections 2024-04-14T10:58:21.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.010+0000 7f292ffed640 1 -- 172.21.15.84:0/1328725387 wait complete. 2024-04-14T10:58:21.020 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.120+0000 7f01584de640 1 Processor -- start 2024-04-14T10:58:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.120+0000 7f01584de640 1 -- start start 2024-04-14T10:58:21.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f01584de640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f01500b3930 0x7f015015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f01584de640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f015015b950 con 0x7f0150155160 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f01584de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01500ccd90 con 0x7f015015b500 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f01584de640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f015015e4d0 con 0x7f01500b3930 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f015627a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f0150155160 0x7f01500cb3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48104/0 (socket says 172.21.15.84:48104) 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f015627a640 1 -- 172.21.15.84:0/3980773879 learned_addr learned my addr 172.21.15.84:0/3980773879 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155a79640 1 --2- 172.21.15.84:0/3980773879 >> v2:172.21.15.175:3300/0 conn(0x7f01500b3930 0x7f015015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150240902 0 0) 0x7f015015b950 con 0x7f0150155160 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013c003520 con 0x7f0150155160 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4134368839 0 0) 0x7f013c003520 con 0x7f0150155160 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 >> v2:172.21.15.175:3300/0 conn(0x7f01500b3930 msgr2=0x7f015015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 --2- 172.21.15.84:0/3980773879 >> v2:172.21.15.175:3300/0 conn(0x7f01500b3930 0x7f015015afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 >> v1:172.21.15.175:6789/0 conn(0x7f015015b500 legacy=0x7f01500cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015015e7b0 con 0x7f0150155160 2024-04-14T10:58:21.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7f014c001670 con 0x7f0150155160 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 >> v1:172.21.15.84:6789/0 conn(0x7f0150155160 legacy=0x7f01500cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f013c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f013c004800 0x7f013c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f013c0051c0 0x7f013c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f015015e4d0 con 0x7f013c0051c0 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f013c00c070 con 0x7f013c0039b0 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f013c00c270 con 0x7f013c004800 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f015627a640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f013c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0155a79640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f013c004800 0x7f013c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.121+0000 7f0156a7b640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f013c0051c0 0x7f013c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f015627a640 1 -- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f013c004800 msgr2=0x7f013c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f015627a640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f013c004800 0x7f013c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f015627a640 1 -- 172.21.15.84:0/3980773879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f013c0051c0 msgr2=0x7f013c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f015627a640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f013c0051c0 0x7f013c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f015627a640 1 -- 172.21.15.84:0/3980773879 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c003520 con 0x7f013c0039b0 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f0156a7b640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f013c0051c0 0x7f013c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f0156a7b640 1 -- 172.21.15.84:0/3980773879 reap_dead start 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.122+0000 7f015627a640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f013c003dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f014c00c240 tx=0x7f013c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e2e53ccce47770d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c007d10 con 0x7f013c0039b0 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c030070 con 0x7f013c0039b0 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f0155278640 1 -- 172.21.15.84:0/3980773879 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c02cdc0 con 0x7f013c0039b0 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 -- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 msgr2=0x7f013c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f013c003dd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f014c00c240 tx=0x7f013c005830 comp rx=0 tx=0).stop 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 -- 172.21.15.84:0/3980773879 shutdown_connections 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 --2- 172.21.15.84:0/3980773879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f013c003dd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 -- 172.21.15.84:0/3980773879 >> 172.21.15.84:0/3980773879 conn(0x7f015006b900 msgr2=0x7f015006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 -- 172.21.15.84:0/3980773879 shutdown_connections 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.123+0000 7f01584de640 1 -- 172.21.15.84:0/3980773879 wait complete. 2024-04-14T10:58:21.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.124+0000 7f01584de640 1 Processor -- start 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.124+0000 7f01584de640 1 -- start start 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f01584de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f01500d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f01584de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 0x7f0150157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f01584de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01501581f0 0x7f01501f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f01584de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f015015f050 con 0x7f01500c9c90 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f01584de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f015015ed70 con 0x7f013c0039b0 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f01584de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0150155540 con 0x7f01501581f0 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 0x7f0150157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 0x7f0150157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43524/0 (socket says 172.21.15.84:43524) 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 -- 172.21.15.84:0/2395966127 learned_addr learned my addr 172.21.15.84:0/2395966127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0156a7b640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01501581f0 0x7f01501f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f015627a640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f01500d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 -- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01501581f0 msgr2=0x7f01501f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01501581f0 0x7f01501f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 -- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 msgr2=0x7f01500d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f01500d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0155a79640 1 -- 172.21.15.84:0/2395966127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01500cf3c0 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.125+0000 7f0156a7b640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01501581f0 0x7f01501f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.126+0000 7f0155a79640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 0x7f0150157cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0140011a70 tx=0x7f0140011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.126+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014000fb50 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.126+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014000fcf0 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.126+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01500cf6a0 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.126+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014000fea0 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.126+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01500cfc60 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.127+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0150069c30 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.127+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0140012040 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.127+0000 7f0146ffd640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f013406c8f0 0x7f013406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.127+0000 7f015627a640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f013406c8f0 0x7f013406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.127+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f014008c0d0 con 0x7f01500c9c90 2024-04-14T10:58:21.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.128+0000 7f015627a640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f013406c8f0 0x7f013406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f014c034000 tx=0x7f014c009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:21.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.132+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f0140019030 con 0x7f01500c9c90 2024-04-14T10:58:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.346+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01500cbf30 con 0x7f01500c9c90 2024-04-14T10:58:21.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.347+0000 7f0146ffd640 1 -- 172.21.15.84:0/2395966127 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7f014005a590 con 0x7f01500c9c90 2024-04-14T10:58:21.345 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:21.346 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T10:58:21.346 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T10:58:21.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.348+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f013406c8f0 msgr2=0x7f013406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.348+0000 7f01584de640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f013406c8f0 0x7f013406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f014c034000 tx=0x7f014c009030 comp rx=0 tx=0).stop 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.348+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 msgr2=0x7f0150157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.348+0000 7f01584de640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 0x7f0150157cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0140011a70 tx=0x7f0140011f30 comp rx=0 tx=0).stop 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 shutdown_connections 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f013406c8f0 0x7f013406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01501581f0 0x7f01501f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01500c9c90 0x7f0150157cb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 --2- 172.21.15.84:0/2395966127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f013c0039b0 0x7f01500d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 >> 172.21.15.84:0/2395966127 conn(0x7f015006b900 msgr2=0x7f015015ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 shutdown_connections 2024-04-14T10:58:21.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:21.349+0000 7f01584de640 1 -- 172.21.15.84:0/2395966127 wait complete. 2024-04-14T10:58:21.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T10:58:03.536145+0000', 'modified': '2024-04-14T10:58:21.259734+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4308, 'mds_1': 4303, 'mds_2': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.175:6834/903884939', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 903884939}, {'type': 'v1', 'addr': '172.21.15.175:6834', 'nonce': 903884939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4303': {'gid': 4303, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6837/442498992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 442498992}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 442498992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4308': {'gid': 4308, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.175:6835/3381016657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6833', 'nonce': 3381016657}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 3381016657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4297, 4303, 4308]} 2024-04-14T10:58:21.962 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-14T10:58:21.963 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-14T10:58:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.067+0000 7f1ff251e640 1 Processor -- start 2024-04-14T10:58:22.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff251e640 1 -- start start 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff251e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fec0cb6b0 0x7f1fec06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff251e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff251e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec15c400 con 0x7f1fec0ce820 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff251e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec15c730 con 0x7f1fec0cb6b0 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff251e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec15b270 con 0x7f1fec0cba90 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1febfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fec0cb6b0 0x7f1fec06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1febfff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1fec0cb6b0 0x7f1fec06fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43526/0 (socket says 172.21.15.84:43526) 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1ff0abb640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1fec0ce820 0x7f1fec15cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:48110/0 (socket says 172.21.15.84:48110) 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1febfff640 1 -- 172.21.15.84:0/3013957521 learned_addr learned my addr 172.21.15.84:0/3013957521 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.068+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/3013957521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.069+0000 7f1febfff640 1 -- 172.21.15.84:0/3013957521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 msgr2=0x7f1fec0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.069+0000 7f1febfff640 1 --2- 172.21.15.84:0/3013957521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec0ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.069+0000 7f1febfff640 1 -- 172.21.15.84:0/3013957521 >> v1:172.21.15.84:6789/0 conn(0x7f1fec0ce820 legacy=0x7f1fec15cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.069+0000 7f1feaffd640 1 -- 172.21.15.84:0/3013957521 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271163794 0 0) 0x7f1fec15c400 con 0x7f1fec0ce820 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.069+0000 7f1febfff640 1 -- 172.21.15.84:0/3013957521 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec15b530 con 0x7f1fec0cb6b0 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.069+0000 7f1febfff640 1 --2- 172.21.15.84:0/3013957521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec06fae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1fec15c8b0 tx=0x7f1fdc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c547448a7ecbfe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1feaffd640 1 -- 172.21.15.84:0/3013957521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc034070 con 0x7f1fec0cb6b0 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1feaffd640 1 -- 172.21.15.84:0/3013957521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc030840 con 0x7f1fec0cb6b0 2024-04-14T10:58:22.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1feaffd640 1 -- 172.21.15.84:0/3013957521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc030c10 con 0x7f1fec0cb6b0 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 -- 172.21.15.84:0/3013957521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0cb6b0 msgr2=0x7f1fec06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3013957521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec06fae0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1fec15c8b0 tx=0x7f1fdc02b980 comp rx=0 tx=0).stop 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 -- 172.21.15.84:0/3013957521 shutdown_connections 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3013957521 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec0ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3013957521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec06fae0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 -- 172.21.15.84:0/3013957521 >> 172.21.15.84:0/3013957521 conn(0x7f1fec06db10 msgr2=0x7f1fec06def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 -- 172.21.15.84:0/3013957521 shutdown_connections 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.070+0000 7f1ff251e640 1 -- 172.21.15.84:0/3013957521 wait complete. 2024-04-14T10:58:22.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.071+0000 7f1ff251e640 1 Processor -- start 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.071+0000 7f1ff251e640 1 -- start start 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff251e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff251e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff251e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 0x7f1fec14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff251e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec15bdd0 con 0x7f1fec0ce820 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff251e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec15baf0 con 0x7f1fec0cb6b0 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff251e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec06c3a0 con 0x7f1fec0cba90 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 0x7f1fec14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 0x7f1fec14e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43534/0 (socket says 172.21.15.84:43534) 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3157944840 learned_addr learned my addr 172.21.15.84:0/3157944840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1febfff640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 msgr2=0x7f1fec1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec0cb6b0 msgr2=0x7f1fec0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec0c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.072+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3157944840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec14f560 con 0x7f1fec0ce820 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.073+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 0x7f1fec14e660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400c750 tx=0x7f1fe400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.073+0000 7f1fe8ff9640 1 -- 172.21.15.84:0/3157944840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4018070 con 0x7f1fec0ce820 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.073+0000 7f1fe8ff9640 1 -- 172.21.15.84:0/3157944840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe400a640 con 0x7f1fec0ce820 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.073+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec14f840 con 0x7f1fec0ce820 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.073+0000 7f1fe8ff9640 1 -- 172.21.15.84:0/3157944840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400ce60 con 0x7f1fec0ce820 2024-04-14T10:58:22.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.073+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec14fe00 con 0x7f1fec0ce820 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.075+0000 7f1fe8ff9640 1 -- 172.21.15.84:0/3157944840 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fe401b070 con 0x7f1fec0ce820 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.075+0000 7f1fe8ff9640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1fd806c8f0 0x7f1fd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.075+0000 7f1fe8ff9640 1 -- 172.21.15.84:0/3157944840 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe408b020 con 0x7f1fec0ce820 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.075+0000 7f1febfff640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1fd806c8f0 0x7f1fd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.075+0000 7f1febfff640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1fd806c8f0 0x7f1fd806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc036000 tx=0x7f1fdc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 Processor -- start 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 -- start start 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9967e0 0x55f2ff996bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff997100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 0x55f2ff9d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff8fb990 con 0x55f2ff995240 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff8a2620 con 0x55f2ff9e0660 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.076+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55f2ff8f7950 con 0x55f2ff9967e0 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1febfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9967e0 0x55f2ff996bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 0x55f2ff9d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1feb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff997100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1febfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9967e0 0x55f2ff996bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:39466/0 (socket says 172.21.15.84:39466) 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 0x55f2ff9d6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43540/0 (socket says 172.21.15.84:43540) 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1febfff640 1 -- 172.21.15.84:0/3132775060 learned_addr learned my addr 172.21.15.84:0/3132775060 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3132775060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9967e0 msgr2=0x55f2ff996bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9967e0 0x55f2ff996bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3132775060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 msgr2=0x55f2ff997100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff997100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 -- 172.21.15.84:0/3132775060 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2ff60e2d0 con 0x55f2ff995240 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 0x55f2ff9d6040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40895a0 tx=0x7f1fe4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9831cb5479736b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1fd1ffb640 1 -- 172.21.15.84:0/3132775060 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4057100 con 0x55f2ff995240 2024-04-14T10:58:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1fd1ffb640 1 -- 172.21.15.84:0/3132775060 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe40711d0 con 0x55f2ff995240 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.077+0000 7f1fd1ffb640 1 -- 172.21.15.84:0/3132775060 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4058250 con 0x55f2ff995240 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 -- 172.21.15.84:0/3132775060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 msgr2=0x55f2ff9d6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 0x55f2ff9d6040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40895a0 tx=0x7f1fe4001250 comp rx=0 tx=0).stop 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 -- 172.21.15.84:0/3132775060 shutdown_connections 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff995240 0x55f2ff9d6040 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff997100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/3132775060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9967e0 0x55f2ff996bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 -- 172.21.15.84:0/3132775060 >> 172.21.15.84:0/3132775060 conn(0x55f2ff992f50 msgr2=0x55f2ff995890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 -- 172.21.15.84:0/3132775060 shutdown_connections 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 -- 172.21.15.84:0/3132775060 wait complete. 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 -- start start 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.078+0000 7f1ff53f9740 1 Processor -- start 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9967e0 0x55f2ff9bae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9e0660 0x55f2ff9e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 0x55f2ff9dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff9bbd40 con 0x55f2ff9d2360 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff8b59e0 con 0x55f2ff9967e0 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55f2ff994100 con 0x55f2ff9e0660 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 0x55f2ff9dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff53f9740 10 client.0 _ll_register_callbacks cb 0x55f2ff8f1220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 0x55f2ff9dbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43542/0 (socket says 172.21.15.84:43542) 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 -- 172.21.15.84:0/1188510359 learned_addr learned my addr 172.21.15.84:0/1188510359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1febfff640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9967e0 0x55f2ff9bae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9e0660 0x55f2ff9e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 -- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9e0660 msgr2=0x55f2ff9e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9e0660 0x55f2ff9e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 -- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9967e0 msgr2=0x55f2ff9bae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.079+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9967e0 0x55f2ff9bae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:22.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff0abb640 1 -- 172.21.15.84:0/1188510359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2ff6d86b0 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 0x55f2ff9dbd00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4061400 tx=0x7f1fe4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e97a2e470316b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1fcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1fcaffd640 1 -- 172.21.15.84:0/1188510359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4058250 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1fcaffd640 1 -- 172.21.15.84:0/1188510359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe40583f0 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fe40711d0 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1fcaffd640 1 -- 172.21.15.84:0/1188510359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f1fe4078300 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 10 client.4725 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55f2ff9d3820 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1fcaffd640 1 -- 172.21.15.84:0/1188510359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe40711d0 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1fcaffd640 1 -- 172.21.15.84:0/1188510359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f1fe405f310 con 0x55f2ff9d2360 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 10 client.4725 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 10 client.4725 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 20 client.4725 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9f45f0 0x55f2ff9f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 4 client.4725 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:58:22.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 --> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2ff9093b0 con 0x55f2ff9f45f0 2024-04-14T10:58:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.080+0000 7f1febfff640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9f45f0 0x55f2ff9f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.081+0000 7f1fcaffd640 10 client.4725 ms_handle_connect on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:22.081+0000 7f1febfff640 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9f45f0 0x55f2ff9f69e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f728770b26b622b server_cookie=d12142e678dcb122 in_seq=0 out_seq=0 2024-04-14T10:58:23.018 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-14T10:58:23.020+0000 7fe1259f1640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-14T10:58:26.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1fcaffd640 1 -- 172.21.15.84:0/1188510359 <== mds.2 v2:172.21.15.175:6832/903884939 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f2ff9093b0 con 0x55f2ff9f45f0 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1fcaffd640 10 client.4725 handle_command_reply: tid=0 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 client.4725 shutdown 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 msgr2=0x55f2ff9dbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 0x55f2ff9dbd00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1fe4061400 tx=0x7f1fe4004f90 comp rx=0 tx=0).stop 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 shutdown_connections 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9f45f0 0x55f2ff9f69e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9d2360 0x55f2ff9dbd00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9e0660 0x55f2ff9e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/1188510359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9967e0 0x55f2ff9bae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1fcaffd640 0 client.4725 ms_handle_reset on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 >> 172.21.15.84:0/1188510359 conn(0x55f2ff995240 msgr2=0x55f2ff98fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.268+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 shutdown_connections 2024-04-14T10:58:26.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.269+0000 7f1ff53f9740 1 -- 172.21.15.84:0/1188510359 wait complete. 2024-04-14T10:58:26.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.269+0000 7f1ff53f9740 20 client.4725 trim_cache size 0 max 16384 2024-04-14T10:58:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.288+0000 7f1ff53f9740 1 Processor -- start 2024-04-14T10:58:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.288+0000 7f1ff53f9740 1 -- start start 2024-04-14T10:58:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff98fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff9901d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff994060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1f0f00 con 0x55f2ff9967e0 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff8b59e0 con 0x55f2ff9e0660 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55f2ff9bbd40 con 0x55f2ff9d2360 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff98fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff98fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41650/0 (socket says 172.21.15.84:41650) 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 -- 172.21.15.84:0/866664380 learned_addr learned my addr 172.21.15.84:0/866664380 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff9901d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff994060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 -- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 msgr2=0x55f2ff9901d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff9901d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 -- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 msgr2=0x55f2ff994060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff994060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 -- 172.21.15.84:0/866664380 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2ff9db540 con 0x55f2ff9967e0 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.289+0000 7f1febfff640 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff98fc90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc000c00 tx=0x7f1fdc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e69e9fa9d5984d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.290+0000 7f1fd17fa640 1 -- 172.21.15.84:0/866664380 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc034040 con 0x55f2ff9967e0 2024-04-14T10:58:26.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.290+0000 7f1fd17fa640 1 -- 172.21.15.84:0/866664380 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc05b030 con 0x55f2ff9967e0 2024-04-14T10:58:26.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.290+0000 7f1fd17fa640 1 -- 172.21.15.84:0/866664380 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc039650 con 0x55f2ff9967e0 2024-04-14T10:58:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.290+0000 7f1ff53f9740 1 -- 172.21.15.84:0/866664380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 msgr2=0x55f2ff98fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.290+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff98fc90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc000c00 tx=0x7f1fdc030000 comp rx=0 tx=0).stop 2024-04-14T10:58:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 -- 172.21.15.84:0/866664380 shutdown_connections 2024-04-14T10:58:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ff994060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff9901d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/866664380 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff98fc90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 -- 172.21.15.84:0/866664380 >> 172.21.15.84:0/866664380 conn(0x55f2ff995240 msgr2=0x55f2ff9dfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 -- 172.21.15.84:0/866664380 shutdown_connections 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 -- 172.21.15.84:0/866664380 wait complete. 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.291+0000 7f1ff53f9740 1 -- start start 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 Processor -- start 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff9fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff990090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ffa4b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff9dc8b0 con 0x55f2ff9967e0 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55f2ff9bbaf0 con 0x55f2ff9e0660 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55f2ff9eb320 con 0x55f2ff9d2360 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1ff53f9740 10 client.0 _ll_register_callbacks cb 0x7f1fe405b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:26.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1febfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff9fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1febfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff9fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41662/0 (socket says 172.21.15.84:41662) 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.292+0000 7f1febfff640 1 -- 172.21.15.84:0/2758251219 learned_addr learned my addr 172.21.15.84:0/2758251219 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1ff0abb640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ffa4b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff990090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1febfff640 1 -- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 msgr2=0x55f2ff990090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1febfff640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff990090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1febfff640 1 -- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 msgr2=0x55f2ffa4b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1febfff640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ffa4b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1febfff640 1 -- 172.21.15.84:0/2758251219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2ff9d16b0 con 0x55f2ff9967e0 2024-04-14T10:58:26.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1febfff640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff9fb9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0096f0 tx=0x7f1fdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cbb554d8afac1c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1fcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1fcaffd640 1 -- 172.21.15.84:0/2758251219 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc034040 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1fcaffd640 1 -- 172.21.15.84:0/2758251219 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1fdc004240 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fdc05b030 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1fcaffd640 1 -- 172.21.15.84:0/2758251219 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f1fdc004440 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1ff53f9740 10 client.4731 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.293+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55f2ff9d2e90 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1fcaffd640 1 -- 172.21.15.84:0/2758251219 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc05b030 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1fcaffd640 1 -- 172.21.15.84:0/2758251219 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f1fdc071080 con 0x55f2ff9967e0 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1ff53f9740 10 client.4731 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1ff53f9740 10 client.4731 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1ff53f9740 20 client.4731 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9df160 0x55f2ffa5e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1ff53f9740 4 client.4731 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:58:26.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 --> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] -- command(tid 0: {"prefix": "status"}) -- 0x55f2ff9d5800 con 0x55f2ff9df160 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9df160 0x55f2ffa5e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1fcaffd640 10 client.4731 ms_handle_connect on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1feb7fe640 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9df160 0x55f2ffa5e150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69d7dc058dfe1ee7 server_cookie=e2857dbf49f2d0b3 in_seq=0 out_seq=0 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.294+0000 7f1fcaffd640 1 -- 172.21.15.84:0/2758251219 <== mds.2 v2:172.21.15.175:6832/903884939 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f2ff9d5800 con 0x55f2ff9df160 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1fcaffd640 10 client.4731 handle_command_reply: tid=0 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 client.4731 shutdown 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 msgr2=0x55f2ff9fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff9fb9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0096f0 tx=0x7f1fdc004730 comp rx=0 tx=0).stop 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 shutdown_connections 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x55f2ff9df160 0x55f2ffa5e150 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f2ff9e0660 0x55f2ffa4b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55f2ff9d2360 0x55f2ff990090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1fcaffd640 0 client.4731 ms_handle_reset on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 --2- 172.21.15.84:0/2758251219 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f2ff9967e0 0x55f2ff9fb9d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 >> 172.21.15.84:0/2758251219 conn(0x55f2ff995240 msgr2=0x55f2ff9dbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 shutdown_connections 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 1 -- 172.21.15.84:0/2758251219 wait complete. 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.295+0000 7f1ff53f9740 20 client.4731 trim_cache size 0 max 16384 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "8f4fd445-3fea-4722-8345-0096c2ce143b", 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4297, 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-04-14T10:58:26.299 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 11.048337719999999, 2024-04-14T10:58:26.300 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 13, 2024-04-14T10:58:26.300 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 20, 2024-04-14T10:58:26.300 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 20, 2024-04-14T10:58:26.300 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 29.265681665999999 2024-04-14T10:58:26.300 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1fd806c8f0 msgr2=0x7f1fd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1fd806c8f0 0x7f1fd806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc036000 tx=0x7f1fdc03b040 comp rx=0 tx=0).stop 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 msgr2=0x7f1fec14e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 0x7f1fec14e660 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400c750 tx=0x7f1fe400cc10 comp rx=0 tx=0).stop 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 shutdown_connections 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1fd806c8f0 0x7f1fd806edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1fec0ce820 0x7f1fec14e660 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fec0cba90 0x7f1fec1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 --2- 172.21.15.84:0/3157944840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fec0cb6b0 0x7f1fec0c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 >> 172.21.15.84:0/3157944840 conn(0x7f1fec06db10 msgr2=0x7f1fec0c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 shutdown_connections 2024-04-14T10:58:26.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.296+0000 7f1ff251e640 1 -- 172.21.15.84:0/3157944840 wait complete. 2024-04-14T10:58:26.307 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-14T10:58:26.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.416+0000 7f8fa9036640 1 Processor -- start 2024-04-14T10:58:26.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.416+0000 7f8fa9036640 1 -- start start 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa9036640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa406f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa9036640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f8fa40ce9f0 0x7f8fa415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa9036640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa41554b0 con 0x7f8fa406fdc0 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa9036640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa415ae50 con 0x7f8fa40ce9f0 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa9036640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa415e340 con 0x7f8fa41550d0 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa406f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8f9bfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8fa406fdc0 0x7f8fa40ce2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:40564/0 (socket says 172.21.15.84:40564) 2024-04-14T10:58:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8f9bfff640 1 -- 172.21.15.84:0/2242856526 learned_addr learned my addr 172.21.15.84:0/2242856526 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa359e640 1 --2- 172.21.15.84:0/2242856526 >> v2:172.21.15.84:3300/0 conn(0x7f8fa40ce9f0 0x7f8fa415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa359e640 1 -- 172.21.15.84:0/2242856526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 msgr2=0x7f8fa406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa359e640 1 --2- 172.21.15.84:0/2242856526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa406f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa359e640 1 -- 172.21.15.84:0/2242856526 >> v1:172.21.15.175:6789/0 conn(0x7f8fa406fdc0 legacy=0x7f8fa40ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.417+0000 7f8fa359e640 1 -- 172.21.15.84:0/2242856526 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa415e600 con 0x7f8fa40ce9f0 2024-04-14T10:58:26.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.418+0000 7f8fa359e640 1 --2- 172.21.15.84:0/2242856526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa415b2e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d90 tx=0x7f8f9c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad43605a0fcaa6ee server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.418+0000 7f8fa259c640 1 -- 172.21.15.84:0/2242856526 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c039070 con 0x7f8fa40ce9f0 2024-04-14T10:58:26.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.418+0000 7f8fa259c640 1 -- 172.21.15.84:0/2242856526 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c02cce0 con 0x7f8fa40ce9f0 2024-04-14T10:58:26.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.418+0000 7f8fa259c640 1 -- 172.21.15.84:0/2242856526 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c034660 con 0x7f8fa40ce9f0 2024-04-14T10:58:26.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 -- 172.21.15.84:0/2242856526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa40ce9f0 msgr2=0x7f8fa415b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 --2- 172.21.15.84:0/2242856526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa415b2e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d90 tx=0x7f8f9c02bf30 comp rx=0 tx=0).stop 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 -- 172.21.15.84:0/2242856526 shutdown_connections 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 --2- 172.21.15.84:0/2242856526 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa415b2e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 --2- 172.21.15.84:0/2242856526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa406f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 -- 172.21.15.84:0/2242856526 >> 172.21.15.84:0/2242856526 conn(0x7f8fa4067d50 msgr2=0x7f8fa406db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 -- 172.21.15.84:0/2242856526 shutdown_connections 2024-04-14T10:58:26.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.419+0000 7f8fa9036640 1 -- 172.21.15.84:0/2242856526 wait complete. 2024-04-14T10:58:26.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.420+0000 7f8fa9036640 1 Processor -- start 2024-04-14T10:58:26.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.420+0000 7f8fa9036640 1 -- start start 2024-04-14T10:58:26.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa9036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 0x7f8fa415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa9036640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa4152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa9036640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa9036640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa415eea0 con 0x7f8fa406fdc0 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa9036640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa415ebc0 con 0x7f8fa40ce9f0 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa9036640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa415f180 con 0x7f8fa41550d0 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 0x7f8fa415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 0x7f8fa415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41676/0 (socket says 172.21.15.84:41676) 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3122982985 learned_addr learned my addr 172.21.15.84:0/3122982985 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa4152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa359e640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.421+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 msgr2=0x7f8fa4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa4158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa40ce9f0 msgr2=0x7f8fa4152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa4152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3122982985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa40cc6d0 con 0x7f8fa406fdc0 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa4152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 0x7f8fa415a670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400e870 tx=0x7f8f9400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8f9b7fe640 1 -- 172.21.15.84:0/3122982985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94017070 con 0x7f8fa406fdc0 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8f9b7fe640 1 -- 172.21.15.84:0/3122982985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9400c940 con 0x7f8fa406fdc0 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa41f4380 con 0x7f8fa406fdc0 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8f9b7fe640 1 -- 172.21.15.84:0/3122982985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400cd30 con 0x7f8fa406fdc0 2024-04-14T10:58:26.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.422+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa41f4940 con 0x7f8fa406fdc0 2024-04-14T10:58:26.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.424+0000 7f8f9b7fe640 1 -- 172.21.15.84:0/3122982985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f9401a070 con 0x7f8fa406fdc0 2024-04-14T10:58:26.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.424+0000 7f8f9b7fe640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8f8406c920 0x7f8f8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.424+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8f8406c920 0x7f8f8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.424+0000 7f8f9b7fe640 1 -- 172.21.15.84:0/3122982985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8f9408b940 con 0x7f8fa406fdc0 2024-04-14T10:58:26.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.424+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8f8406c920 0x7f8f8406ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8fa41539e0 tx=0x7f8f8c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.425+0000 7f8fabe3c740 1 Processor -- start 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.425+0000 7f8fabe3c740 1 -- start start 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607ee6abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607ee6b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee69240 0x55607eeaa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55607edcf990 con 0x55607ee6a7e0 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55607ed76620 con 0x55607ee69240 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55607edcb950 con 0x55607eeb4660 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607ee6abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607ee6abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41678/0 (socket says 172.21.15.84:41678) 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/1452868265 learned_addr learned my addr 172.21.15.84:0/1452868265 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607ee6b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa359e640 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee69240 0x55607eeaa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 msgr2=0x55607ee6b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607ee6b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee69240 msgr2=0x55607eeaa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee69240 0x55607eeaa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/1452868265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607eae22d0 con 0x55607ee6a7e0 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607ee6abc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f94061db0 tx=0x7f8f9400efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5c0f40226e4131 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8f98ff9640 1 -- 172.21.15.84:0/1452868265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94021050 con 0x55607ee6a7e0 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8f98ff9640 1 -- 172.21.15.84:0/1452868265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9405dab0 con 0x55607ee6a7e0 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.426+0000 7f8f98ff9640 1 -- 172.21.15.84:0/1452868265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f940622e0 con 0x55607ee6a7e0 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 -- 172.21.15.84:0/1452868265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 msgr2=0x55607ee6abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607ee6abc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f94061db0 tx=0x7f8f9400efa0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 -- 172.21.15.84:0/1452868265 shutdown_connections 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee69240 0x55607eeaa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607ee6b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/1452868265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607ee6abc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 -- 172.21.15.84:0/1452868265 >> 172.21.15.84:0/1452868265 conn(0x55607ee66f50 msgr2=0x55607ee69890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 -- 172.21.15.84:0/1452868265 shutdown_connections 2024-04-14T10:58:26.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.427+0000 7f8fabe3c740 1 -- 172.21.15.84:0/1452868265 wait complete. 2024-04-14T10:58:26.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 -- start start 2024-04-14T10:58:26.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 Processor -- start 2024-04-14T10:58:26.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607eea6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eeafc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607ee8f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55607ee8fd40 con 0x55607eeaf3c0 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55607ed899e0 con 0x55607ee6a7e0 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55607ee68100 con 0x55607eeb4660 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.428+0000 7f8fabe3c740 10 client.0 _ll_register_callbacks cb 0x55607edc5220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607ee8f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eeafc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607ee8f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41688/0 (socket says 172.21.15.84:41688) 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 -- 172.21.15.84:0/414521599 learned_addr learned my addr 172.21.15.84:0/414521599 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607eea6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 -- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 msgr2=0x55607eeafc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eeafc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 -- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 msgr2=0x55607eea6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607eea6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 -- 172.21.15.84:0/414521599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607ebac6b0 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fa359e640 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607ee8f020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c037040 tx=0x7f8f9c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd759cba936dc66 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8f81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8f81ffb640 1 -- 172.21.15.84:0/414521599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c039040 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8f81ffb640 1 -- 172.21.15.84:0/414521599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8f9c034a10 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f9405dab0 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8f81ffb640 1 -- 172.21.15.84:0/414521599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f8f9c034c10 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fabe3c740 10 client.4743 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55607eeb5080 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.429+0000 7f8f81ffb640 1 -- 172.21.15.84:0/414521599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9405dab0 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8f81ffb640 1 -- 172.21.15.84:0/414521599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f8f9c003990 con 0x55607eeaf3c0 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fabe3c740 10 client.4743 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:26.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fabe3c740 10 client.4743 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fabe3c740 20 client.4743 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607eebee20 0x55607eeca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fabe3c740 4 client.4743 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 --> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55607eddd3b0 con 0x55607eebee20 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607eebee20 0x55607eeca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607eebee20 0x55607eeca5c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18434d19f3e8f20e server_cookie=af927f3ab77677b1 in_seq=0 out_seq=0 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.430+0000 7f8f81ffb640 10 client.4743 ms_handle_connect on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8f81ffb640 1 -- 172.21.15.84:0/414521599 <== mds.1 v2:172.21.15.175:6836/442498992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55607eddd3b0 con 0x55607eebee20 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8f81ffb640 10 client.4743 handle_command_reply: tid=0 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 client.4743 shutdown 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 msgr2=0x55607ee8f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607ee8f020 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c037040 tx=0x7f8f9c004ab0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 shutdown_connections 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607eebee20 0x55607eeca5c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607ee8f020 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eeafc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/414521599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607eea6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8f81ffb640 0 client.4743 ms_handle_reset on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 >> 172.21.15.84:0/414521599 conn(0x55607ee69240 msgr2=0x55607ee63c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 shutdown_connections 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 1 -- 172.21.15.84:0/414521599 wait complete. 2024-04-14T10:58:26.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.431+0000 7f8fabe3c740 20 client.4743 trim_cache size 0 max 16384 2024-04-14T10:58:26.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 Processor -- start 2024-04-14T10:58:26.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 -- start start 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607eebbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeaf3c0 0x55607ee68400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607eeb4660 0x55607ee68940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa4157c40 con 0x55607ee6a7e0 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55607eeb55e0 con 0x55607eeb4660 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55607eeb5b00 con 0x55607eeaf3c0 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607eebbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.450+0000 7f8fa2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607eebbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41694/0 (socket says 172.21.15.84:41694) 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3465158238 learned_addr learned my addr 172.21.15.84:0/3465158238 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa359e640 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607eeb4660 0x55607ee68940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeaf3c0 msgr2=0x55607ee68400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeaf3c0 0x55607ee68400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607eeb4660 msgr2=0x55607ee68940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607eeb4660 0x55607ee68940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 -- 172.21.15.84:0/3465158238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607eeb0000 con 0x55607ee6a7e0 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607eebbdb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f94059400 tx=0x7f8f9405b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a990deb6297466 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8f83fff640 1 -- 172.21.15.84:0/3465158238 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94021040 con 0x55607ee6a7e0 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8f83fff640 1 -- 172.21.15.84:0/3465158238 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f94057a00 con 0x55607ee6a7e0 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8f83fff640 1 -- 172.21.15.84:0/3465158238 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f94058b50 con 0x55607ee6a7e0 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3465158238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 msgr2=0x55607eebbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.451+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607eebbdb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f94059400 tx=0x7f8f9405b000 comp rx=0 tx=0).stop 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3465158238 shutdown_connections 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607eeb4660 0x55607ee68940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeaf3c0 0x55607ee68400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3465158238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607ee6a7e0 0x55607eebbdb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3465158238 >> 172.21.15.84:0/3465158238 conn(0x55607ee69240 msgr2=0x55607eeb2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3465158238 shutdown_connections 2024-04-14T10:58:26.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3465158238 wait complete. 2024-04-14T10:58:26.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 -- start start 2024-04-14T10:58:26.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.452+0000 7f8fabe3c740 1 Processor -- start 2024-04-14T10:58:26.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607ee68460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607eea54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eea59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55607eebeca0 con 0x55607eeaf3c0 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55607ee940b0 con 0x55607ee6a7e0 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55607eebf2f0 con 0x55607eeb4660 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fabe3c740 10 client.0 _ll_register_callbacks cb 0x7f8f9c037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607eea54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607eea54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41700/0 (socket says 172.21.15.84:41700) 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 -- 172.21.15.84:0/3894461100 learned_addr learned my addr 172.21.15.84:0/3894461100 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607ee68460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8fa359e640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eea59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 -- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 msgr2=0x55607eea59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eea59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 -- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 msgr2=0x55607ee68460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607ee68460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 -- 172.21.15.84:0/3894461100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607eeb1940 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f9bfff640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607eea54b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fa415d9a0 tx=0x7f8f8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e66c7f3e240741 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.453+0000 7f8f81ffb640 1 -- 172.21.15.84:0/3894461100 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00ec80 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8f81ffb640 1 -- 172.21.15.84:0/3894461100 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8f8c01e040 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f94057a00 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8f81ffb640 1 -- 172.21.15.84:0/3894461100 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f8f8c00ee20 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 10 client.4749 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55607eece5e0 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8f81ffb640 1 -- 172.21.15.84:0/3894461100 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f94057a00 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8f81ffb640 1 -- 172.21.15.84:0/3894461100 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f8f8c02f700 con 0x55607eeaf3c0 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 10 client.4749 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 10 client.4749 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 20 client.4749 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:26.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607ef29380 0x55607ef3bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 4 client.4749 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 --> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] -- command(tid 0: {"prefix": "status"}) -- 0x55607eeb44b0 con 0x55607ef29380 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607ef29380 0x55607ef3bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8f81ffb640 10 client.4749 ms_handle_connect on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.454+0000 7f8fa2d9d640 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607ef29380 0x55607ef3bae0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=706479c1675af1f7 server_cookie=6b0329ef8d6163be in_seq=0 out_seq=0 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8f81ffb640 1 -- 172.21.15.84:0/3894461100 <== mds.1 v2:172.21.15.175:6836/442498992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55607eeb44b0 con 0x55607ef29380 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8f81ffb640 10 client.4749 handle_command_reply: tid=0 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 client.4749 shutdown 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 msgr2=0x55607eea54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607eea54b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8fa415d9a0 tx=0x7f8f8c000ed0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 shutdown_connections 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55607ef29380 0x55607ef3bae0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55607eeb4660 0x55607eea59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55607eeaf3c0 0x55607eea54b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 --2- 172.21.15.84:0/3894461100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55607ee6a7e0 0x55607ee68460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8f81ffb640 0 client.4749 ms_handle_reset on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 >> 172.21.15.84:0/3894461100 conn(0x55607ee69240 msgr2=0x55607eea69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 shutdown_connections 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 1 -- 172.21.15.84:0/3894461100 wait complete. 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fabe3c740 20 client.4749 trim_cache size 0 max 16384 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "8f4fd445-3fea-4722-8345-0096c2ce143b", 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4303, 2024-04-14T10:58:26.462 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 17.231805366, 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 13, 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 20, 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 20, 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 29.423534747000001 2024-04-14T10:58:26.463 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8f8406c920 msgr2=0x7f8f8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8f8406c920 0x7f8f8406ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8fa41539e0 tx=0x7f8f8c009040 comp rx=0 tx=0).stop 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 msgr2=0x7f8fa415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 0x7f8fa415a670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400e870 tx=0x7f8f9400ed30 comp rx=0 tx=0).stop 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 shutdown_connections 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8f8406c920 0x7f8f8406ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fa41550d0 0x7f8fa4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fa40ce9f0 0x7f8fa4152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 --2- 172.21.15.84:0/3122982985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fa406fdc0 0x7f8fa415a670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 >> 172.21.15.84:0/3122982985 conn(0x7f8fa4067d50 msgr2=0x7f8fa415dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 shutdown_connections 2024-04-14T10:58:26.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.455+0000 7f8fa9036640 1 -- 172.21.15.84:0/3122982985 wait complete. 2024-04-14T10:58:26.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-14T10:58:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 Processor -- start 2024-04-14T10:58:26.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 -- start start 2024-04-14T10:58:26.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f501806f8b0 0x7f50180c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f50180ce930 0x7f50180cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50180c7fa0 con 0x7f50180ce550 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f50180c20b0 con 0x7f501806f8b0 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.569+0000 7f501e4b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f50181591d0 con 0x7f50180ce930 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f501806f8b0 0x7f50180c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f501806f8b0 0x7f50180c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41712/0 (socket says 172.21.15.84:41712) 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 -- 172.21.15.84:0/3526160712 learned_addr learned my addr 172.21.15.84:0/3526160712 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f501ca54640 1 --2- 172.21.15.84:0/3526160712 >> v2:172.21.15.175:3300/0 conn(0x7f50180ce930 0x7f50180cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 -- 172.21.15.84:0/3526160712 >> v2:172.21.15.175:3300/0 conn(0x7f50180ce930 msgr2=0x7f50180cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 --2- 172.21.15.84:0/3526160712 >> v2:172.21.15.175:3300/0 conn(0x7f50180ce930 0x7f50180cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 -- 172.21.15.84:0/3526160712 >> v1:172.21.15.175:6789/0 conn(0x7f50180ce550 legacy=0x7f5018159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.570+0000 7f50177fe640 1 -- 172.21.15.84:0/3526160712 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50180c8280 con 0x7f501806f8b0 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f50177fe640 1 --2- 172.21.15.84:0/3526160712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501806f8b0 0x7f50180c7940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50180725e0 tx=0x7f500c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d528e7278c38d64 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f5016ffd640 1 -- 172.21.15.84:0/3526160712 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c034070 con 0x7f501806f8b0 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f5016ffd640 1 -- 172.21.15.84:0/3526160712 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c030860 con 0x7f501806f8b0 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f5016ffd640 1 -- 172.21.15.84:0/3526160712 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c030c30 con 0x7f501806f8b0 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 -- 172.21.15.84:0/3526160712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501806f8b0 msgr2=0x7f50180c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3526160712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501806f8b0 0x7f50180c7940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50180725e0 tx=0x7f500c02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 -- 172.21.15.84:0/3526160712 shutdown_connections 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3526160712 >> v2:172.21.15.175:3300/0 conn(0x7f50180ce930 0x7f50180cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3526160712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501806f8b0 0x7f50180c7940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 -- 172.21.15.84:0/3526160712 >> 172.21.15.84:0/3526160712 conn(0x7f501806db10 msgr2=0x7f501806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 -- 172.21.15.84:0/3526160712 shutdown_connections 2024-04-14T10:58:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.571+0000 7f501e4b7640 1 -- 172.21.15.84:0/3526160712 wait complete. 2024-04-14T10:58:26.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.572+0000 7f501e4b7640 1 Processor -- start 2024-04-14T10:58:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 -- start start 2024-04-14T10:58:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f501806f8b0 0x7f50181e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50180ce550 0x7f50181ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 0x7f50180c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f50180cbb70 con 0x7f50180ce930 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5018158e60 con 0x7f501806f8b0 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501e4b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f501815c230 con 0x7f50180ce550 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501ca54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 0x7f50180c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501ca54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 0x7f50180c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41718/0 (socket says 172.21.15.84:41718) 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.573+0000 7f501ca54640 1 -- 172.21.15.84:0/3463870758 learned_addr learned my addr 172.21.15.84:0/3463870758 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f50177fe640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50180ce550 0x7f50181ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f5017fff640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f501806f8b0 0x7f50181e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501ca54640 1 -- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50180ce550 msgr2=0x7f50181ef480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501ca54640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50180ce550 0x7f50181ef480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501ca54640 1 -- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f501806f8b0 msgr2=0x7f50181e3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501ca54640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f501806f8b0 0x7f50181e3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501ca54640 1 -- 172.21.15.84:0/3463870758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50181ef9c0 con 0x7f50180ce930 2024-04-14T10:58:26.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501ca54640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 0x7f50180c5a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5010007c90 tx=0x7f501000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f5014ff9640 1 -- 172.21.15.84:0/3463870758 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010014420 con 0x7f50180ce930 2024-04-14T10:58:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f5014ff9640 1 -- 172.21.15.84:0/3463870758 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010019070 con 0x7f50180ce930 2024-04-14T10:58:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50180c4b90 con 0x7f50180ce930 2024-04-14T10:58:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f5014ff9640 1 -- 172.21.15.84:0/3463870758 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010014820 con 0x7f50180ce930 2024-04-14T10:58:26.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.574+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50181eec80 con 0x7f50180ce930 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.575+0000 7f5014ff9640 1 -- 172.21.15.84:0/3463870758 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50100149c0 con 0x7f50180ce930 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.576+0000 7f5014ff9640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f500406c8f0 0x7f500406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.576+0000 7f5014ff9640 1 -- 172.21.15.84:0/3463870758 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f501008c160 con 0x7f50180ce930 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.576+0000 7f5017fff640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f500406c8f0 0x7f500406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.576+0000 7f5017fff640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f500406c8f0 0x7f500406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5008004f60 tx=0x7f5008007e30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.577+0000 7f5021371740 1 Processor -- start 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.577+0000 7f5021371740 1 -- start start 2024-04-14T10:58:26.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9c770 0x55e6b9d9efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cb50 0x55e6b9da15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5021371740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9da1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5021371740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9d06990 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9cad620 con 0x55e6b9d9c770 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55e6b9d02950 con 0x55e6b9d9cb50 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9da1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5017fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9c770 0x55e6b9d9efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9da1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41734/0 (socket says 172.21.15.84:41734) 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 -- 172.21.15.84:0/2003216773 learned_addr learned my addr 172.21.15.84:0/2003216773 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f50177fe640 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cb50 0x55e6b9da15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 -- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cb50 msgr2=0x55e6b9da15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cb50 0x55e6b9da15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 -- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9c770 msgr2=0x55e6b9d9efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9c770 0x55e6b9d9efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 -- 172.21.15.84:0/2003216773 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b9a192d0 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f5017fff640 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9c770 0x55e6b9d9efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f501ca54640 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9da1b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5010062540 tx=0x7f5010014d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9159b724eca94055 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f4ffdffb640 1 -- 172.21.15.84:0/2003216773 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010062a70 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f4ffdffb640 1 -- 172.21.15.84:0/2003216773 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010058240 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.578+0000 7f4ffdffb640 1 -- 172.21.15.84:0/2003216773 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100625e0 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 -- 172.21.15.84:0/2003216773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 msgr2=0x55e6b9da1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9da1b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5010062540 tx=0x7f5010014d70 comp rx=0 tx=0).stop 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 -- 172.21.15.84:0/2003216773 shutdown_connections 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9da1b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cb50 0x55e6b9da15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 --2- 172.21.15.84:0/2003216773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9c770 0x55e6b9d9efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 -- 172.21.15.84:0/2003216773 >> 172.21.15.84:0/2003216773 conn(0x55e6b9d9df50 msgr2=0x55e6b9da0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 -- 172.21.15.84:0/2003216773 shutdown_connections 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 -- 172.21.15.84:0/2003216773 wait complete. 2024-04-14T10:58:26.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.579+0000 7f5021371740 1 -- start start 2024-04-14T10:58:26.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 Processor -- start 2024-04-14T10:58:26.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 0x55e6b9dc51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9ded8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9dc2730 0x55e6b9da1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9de0f90 con 0x55e6b9d9cb50 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9cc09e0 con 0x55e6b9dc2730 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55e6b9da33b0 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5021371740 10 client.0 _ll_register_callbacks cb 0x55e6b9cfc220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5017fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 0x55e6b9dc51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.580+0000 7f5017fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 0x55e6b9dc51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41746/0 (socket says 172.21.15.84:41746) 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 -- 172.21.15.84:0/2919632528 learned_addr learned my addr 172.21.15.84:0/2919632528 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f50177fe640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9ded8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f501ca54640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9dc2730 0x55e6b9da1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 -- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 msgr2=0x55e6b9ded8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9ded8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 -- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9dc2730 msgr2=0x55e6b9da1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9dc2730 0x55e6b9da1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 -- 172.21.15.84:0/2919632528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b9ae36b0 con 0x55e6b9d9cb50 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f501ca54640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9dc2730 0x55e6b9da1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f50177fe640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9ded8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5017fff640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 0x55e6b9dc51b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f500800fe00 tx=0x7f5008003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1550e21c8d54583 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f4ff6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/2919632528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008025020 con 0x55e6b9d9cb50 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/2919632528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5008014450 con 0x55e6b9d9cb50 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5010058240 con 0x55e6b9d9cb50 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/2919632528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f500802f050 con 0x55e6b9d9cb50 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5021371740 10 client.4761 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55e6b9dfaa10 con 0x55e6b9d9cb50 2024-04-14T10:58:26.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/2919632528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010058240 con 0x55e6b9d9cb50 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/2919632528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f5008032020 con 0x55e6b9d9cb50 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.581+0000 7f5021371740 10 client.4761 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f5021371740 10 client.4761 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f5021371740 20 client.4761 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f5021371740 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9da1f80 0x55e6b9dbd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f5021371740 4 client.4761 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6b9d143b0 con 0x55e6b9da1f80 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f50177fe640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9da1f80 0x55e6b9dbd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f4ff6ffd640 10 client.4761 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.582+0000 7f50177fe640 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9da1f80 0x55e6b9dbd2a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f35453ea7eb5ea server_cookie=2ae2e5a5011a7ffc in_seq=0 out_seq=0 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/2919632528 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e6b9d143b0 con 0x55e6b9da1f80 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f4ff6ffd640 10 client.4761 handle_command_reply: tid=0 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 client.4761 shutdown 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 msgr2=0x55e6b9dc51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 0x55e6b9dc51b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f500800fe00 tx=0x7f5008003760 comp rx=0 tx=0).stop 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 shutdown_connections 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9da1f80 0x55e6b9dbd2a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9dc2730 0x55e6b9da1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9ded8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f4ff6ffd640 0 client.4761 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 --2- 172.21.15.84:0/2919632528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cb50 0x55e6b9dc51b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 >> 172.21.15.84:0/2919632528 conn(0x55e6b9d9c770 msgr2=0x55e6b9d9b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 shutdown_connections 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 1 -- 172.21.15.84:0/2919632528 wait complete. 2024-04-14T10:58:26.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.583+0000 7f5021371740 20 client.4761 trim_cache size 0 max 16384 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.601+0000 7f5021371740 1 Processor -- start 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.601+0000 7f5021371740 1 -- start start 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e0afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9dc7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5021371740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 0x55e6b9dc7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5021371740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f501806cd00 con 0x55e6b9dc2730 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9dfacf0 con 0x55e6b9d9cb50 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55e6b9de2430 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 0x55e6b9dc7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 0x55e6b9dc7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41752/0 (socket says 172.21.15.84:41752) 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 -- 172.21.15.84:0/3600169443 learned_addr learned my addr 172.21.15.84:0/3600169443 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f5017fff640 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e0afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f50177fe640 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9dc7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 -- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 msgr2=0x55e6b9dc7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9dc7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 -- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 msgr2=0x55e6b9e0afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e0afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 -- 172.21.15.84:0/3600169443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6b9de1120 con 0x55e6b9dc2730 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f501ca54640 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 0x55e6b9dc7d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f501000e9b0 tx=0x7f5010014de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd5fd573680158f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f4ffd7fa640 1 -- 172.21.15.84:0/3600169443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010077070 con 0x55e6b9dc2730 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f4ffd7fa640 1 -- 172.21.15.84:0/3600169443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010062a70 con 0x55e6b9dc2730 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.602+0000 7f4ffd7fa640 1 -- 172.21.15.84:0/3600169443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501008a230 con 0x55e6b9dc2730 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 -- 172.21.15.84:0/3600169443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 msgr2=0x55e6b9dc7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 0x55e6b9dc7d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f501000e9b0 tx=0x7f5010014de0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 -- 172.21.15.84:0/3600169443 shutdown_connections 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9dc2730 0x55e6b9dc7d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9d9cfb0 0x55e6b9dc7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 --2- 172.21.15.84:0/3600169443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e0afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 -- 172.21.15.84:0/3600169443 >> 172.21.15.84:0/3600169443 conn(0x55e6b9d9c770 msgr2=0x55e6b9d9be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 -- 172.21.15.84:0/3600169443 shutdown_connections 2024-04-14T10:58:26.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 -- 172.21.15.84:0/3600169443 wait complete. 2024-04-14T10:58:26.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.603+0000 7f5021371740 1 -- start start 2024-04-14T10:58:26.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 Processor -- start 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e65cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9dc8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9dc2730 0x55e6b9e5b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9dbd120 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55e6b9dee140 con 0x55e6b9d9cb50 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55e6b9dbd7f0 con 0x55e6b9dc2730 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5021371740 10 client.0 _ll_register_callbacks cb 0x7f5008003940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f50177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9dc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f50177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9dc8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41758/0 (socket says 172.21.15.84:41758) 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f50177fe640 1 -- 172.21.15.84:0/3056980925 learned_addr learned my addr 172.21.15.84:0/3056980925 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f501ca54640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9dc2730 0x55e6b9e5b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.604+0000 7f5017fff640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e65cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f50177fe640 1 -- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9dc2730 msgr2=0x55e6b9e5b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f50177fe640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9dc2730 0x55e6b9e5b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f50177fe640 1 -- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 msgr2=0x55e6b9e65cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f50177fe640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e65cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f50177fe640 1 -- 172.21.15.84:0/3056980925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6b9e09b70 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f50177fe640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9dc8100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f500c009960 tx=0x7f500c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63828962900acc4a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f4ff6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/3056980925 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c034040 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/3056980925 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f500c04a430 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5010062a70 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/3056980925 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f500c05b050 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 10 client.4767 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55e6b9dc4f50 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/3056980925 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010062a70 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/3056980925 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f500c05e020 con 0x55e6b9d9cfb0 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 10 client.4767 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 10 client.4767 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-14T10:58:26.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 20 client.4767 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9d9f740 0x55e6b9e6e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 4 client.4767 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.605+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "status"}) -- 0x55e6b9d0e220 con 0x55e6b9d9f740 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5017fff640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9d9f740 0x55e6b9e6e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5017fff640 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9d9f740 0x55e6b9e6e650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f4a1aedf733f48b server_cookie=96b1e83c19463b76 in_seq=0 out_seq=0 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f4ff6ffd640 10 client.4767 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f4ff6ffd640 1 -- 172.21.15.84:0/3056980925 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55e6b9d0e220 con 0x55e6b9d9f740 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f4ff6ffd640 10 client.4767 handle_command_reply: tid=0 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 client.4767 shutdown 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 msgr2=0x55e6b9dc8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9dc8100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f500c009960 tx=0x7f500c02e000 comp rx=0 tx=0).stop 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 shutdown_connections 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55e6b9d9f740 0x55e6b9e6e650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55e6b9dc2730 0x55e6b9e5b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6b9d9cfb0 0x55e6b9dc8100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 --2- 172.21.15.84:0/3056980925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e6b9d9cb50 0x55e6b9e65cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f4ff6ffd640 0 client.4767 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 >> 172.21.15.84:0/3056980925 conn(0x55e6b9d9c770 msgr2=0x55e6b9ded230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 shutdown_connections 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 1 -- 172.21.15.84:0/3056980925 wait complete. 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.606+0000 7f5021371740 20 client.4767 trim_cache size 0 max 16384 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "8f4fd445-3fea-4722-8345-0096c2ce143b", 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4308, 2024-04-14T10:58:26.611 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 22.411092078999999, 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 13, 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 20, 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 20, 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 29.577112459999999 2024-04-14T10:58:26.612 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f500406c8f0 msgr2=0x7f500406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f500406c8f0 0x7f500406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5008004f60 tx=0x7f5008007e30 comp rx=0 tx=0).stop 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 msgr2=0x7f50180c5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 0x7f50180c5a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5010007c90 tx=0x7f501000e4b0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 shutdown_connections 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f500406c8f0 0x7f500406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f50180ce930 0x7f50180c5a00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50180ce550 0x7f50181ef480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 --2- 172.21.15.84:0/3463870758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f501806f8b0 0x7f50181e3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 >> 172.21.15.84:0/3463870758 conn(0x7f501806db10 msgr2=0x7f501806def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 shutdown_connections 2024-04-14T10:58:26.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.607+0000 7f501e4b7640 1 -- 172.21.15.84:0/3463870758 wait complete. 2024-04-14T10:58:26.616 INFO:teuthology.run_tasks:Running task sequential... 2024-04-14T10:58:26.652 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-14T10:58:26.652 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-14T10:58:26.664 INFO:teuthology.task.print:Enabling mgr modules 2024-04-14T10:58:26.664 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-14T10:58:26.729 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-14T10:58:26.730 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-14T10:58:26.730 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-14T10:58:26.730 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T10:58:26.730 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:26.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:26.731 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-04-14T10:58:26.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:26.747 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-04-14T10:58:26.815 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-04-14T10:58:26.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:58:26.817 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-14T10:58:26.817 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T10:58:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.958+0000 7f7428436640 1 Processor -- start 2024-04-14T10:58:26.957 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.958+0000 7f7428436640 1 -- start start 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f7428436640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74200738e0 0x7f74200c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f7428436640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7420152f80 con 0x7f74200c70c0 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f7428436640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7420073ed0 con 0x7f7420152ba0 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f7428436640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f742006ca40 con 0x7f74200738e0 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f74259d1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74200738e0 0x7f74200c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f74259d1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f74200738e0 0x7f74200c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41772/0 (socket says 172.21.15.84:41772) 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f74269d3640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f74200c70c0 0x7f7420158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52306/0 (socket says 172.21.15.84:52306) 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.959+0000 7f74259d1640 1 -- 172.21.15.84:0/91935590 learned_addr learned my addr 172.21.15.84:0/91935590 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.960+0000 7f74259d1640 1 -- 172.21.15.84:0/91935590 >> v1:172.21.15.175:6789/0 conn(0x7f7420152ba0 legacy=0x7f742006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:26.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.960+0000 7f74259d1640 1 -- 172.21.15.84:0/91935590 >> v1:172.21.15.84:6789/0 conn(0x7f74200c70c0 legacy=0x7f7420158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.960+0000 7f74259d1640 1 -- 172.21.15.84:0/91935590 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200c7f10 con 0x7f74200738e0 2024-04-14T10:58:26.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.960+0000 7f74251d0640 1 -- 172.21.15.84:0/91935590 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620630751 0 0) 0x7f7420152f80 con 0x7f74200c70c0 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.960+0000 7f74259d1640 1 --2- 172.21.15.84:0/91935590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200738e0 0x7f74200c6b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5feafe81fa2b8090 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.960+0000 7f74251d0640 1 -- 172.21.15.84:0/91935590 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741002f840 con 0x7f74200738e0 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f74251d0640 1 -- 172.21.15.84:0/91935590 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741002f9e0 con 0x7f74200738e0 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f74251d0640 1 -- 172.21.15.84:0/91935590 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741002fdb0 con 0x7f74200738e0 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 -- 172.21.15.84:0/91935590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200738e0 msgr2=0x7f74200c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 --2- 172.21.15.84:0/91935590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200738e0 0x7f74200c6b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f741002ba20 comp rx=0 tx=0).stop 2024-04-14T10:58:26.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 -- 172.21.15.84:0/91935590 shutdown_connections 2024-04-14T10:58:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 --2- 172.21.15.84:0/91935590 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200738e0 0x7f74200c6b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 -- 172.21.15.84:0/91935590 >> 172.21.15.84:0/91935590 conn(0x7f74200cdc60 msgr2=0x7f74200c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 -- 172.21.15.84:0/91935590 shutdown_connections 2024-04-14T10:58:26.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.961+0000 7f7428436640 1 -- 172.21.15.84:0/91935590 wait complete. 2024-04-14T10:58:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.962+0000 7f7428436640 1 Processor -- start 2024-04-14T10:58:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.962+0000 7f7428436640 1 -- start start 2024-04-14T10:58:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f7428436640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74200738e0 0x7f742014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f7428436640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 0x7f74201f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f7428436640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7420152ba0 0x7f74200c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f7428436640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f742006cc90 con 0x7f74200c70c0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f7428436640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74200c84d0 con 0x7f74200738e0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f7428436640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f742006cf70 con 0x7f7420152ba0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 0x7f74201f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 0x7f74201f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41782/0 (socket says 172.21.15.84:41782) 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 -- 172.21.15.84:0/2845660357 learned_addr learned my addr 172.21.15.84:0/2845660357 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74261d2640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74200738e0 0x7f742014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74269d3640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7420152ba0 0x7f74200c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 -- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7420152ba0 msgr2=0x7f74200c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7420152ba0 0x7f74200c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 -- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74200738e0 msgr2=0x7f742014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74200738e0 0x7f742014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74259d1640 1 -- 172.21.15.84:0/2845660357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74200c4a10 con 0x7f74200c70c0 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74261d2640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74200738e0 0x7f742014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:26.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.963+0000 7f74269d3640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7420152ba0 0x7f74200c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.964+0000 7f74259d1640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 0x7f74201f13d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f7410004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.964+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741002f800 con 0x7f74200c70c0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.964+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7410046070 con 0x7f74200c70c0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.964+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74200c4cb0 con 0x7f74200c70c0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.964+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410041640 con 0x7f74200c70c0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.964+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74200c5270 con 0x7f74200c70c0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.965+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420069c30 con 0x7f74200c70c0 2024-04-14T10:58:26.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.965+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7410040070 con 0x7f74200c70c0 2024-04-14T10:58:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.965+0000 7f7416ffd640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740406c920 0x7f740406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.966+0000 7f74261d2640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740406c920 0x7f740406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.966+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f74100ae320 con 0x7f74200c70c0 2024-04-14T10:58:26.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.966+0000 7f74261d2640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740406c920 0x7f740406ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f741c006fd0 tx=0x7f741c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:26.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:26.970+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f7410033030 con 0x7f74200c70c0 2024-04-14T10:58:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.183+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f74200736c0 con 0x7f74200c70c0 2024-04-14T10:58:27.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.183+0000 7f7416ffd640 1 -- 172.21.15.84:0/2845660357 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f741007c7e0 con 0x7f74200c70c0 2024-04-14T10:58:27.182 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740406c920 msgr2=0x7f740406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740406c920 0x7f740406ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f741c006fd0 tx=0x7f741c008040 comp rx=0 tx=0).stop 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 msgr2=0x7f74201f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 0x7f74201f13d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7410009870 tx=0x7f7410004730 comp rx=0 tx=0).stop 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 shutdown_connections 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740406c920 0x7f740406ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7420152ba0 0x7f74200c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74200c70c0 0x7f74201f13d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 --2- 172.21.15.84:0/2845660357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74200738e0 0x7f742014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 >> 172.21.15.84:0/2845660357 conn(0x7f74200cdc60 msgr2=0x7f74201501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:27.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 shutdown_connections 2024-04-14T10:58:27.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27.185+0000 7f7428436640 1 -- 172.21.15.84:0/2845660357 wait complete. 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T10:58:27.195 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:58:27.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:27.196 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-04-14T10:58:27.210 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T10:58:27.210 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T10:58:27.210 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T10:58:27.210 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:58:27.210 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-14T10:58:27.211 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42703sec preferred_lft 42703sec 2024-04-14T10:58:27.212 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link 2024-04-14T10:58:27.212 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:58:27.212 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T10:58:27.212 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:58:27.212 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-14T10:58:27.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-04-14T10:58:27.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-04-14T10:58:27.212 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-04-14T10:58:27.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T10:58:27.213 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-14T10:58:27.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:58:27.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:58:27.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:27.425 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T10:58:27.452 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-04-14T10:58:27.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:27.454 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-04-14T10:58:27.530 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-04-14T10:58:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T10:58:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T10:58:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T10:58:27.531 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T10:58:27.531 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:58:27.531 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-14T10:58:27.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T10:58:27.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T10:58:27.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T10:58:27.532 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-14T10:58:27.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:58:27.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:58:27.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:27.851 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-04-14T10:58:27.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:27.866 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-04-14T10:58:27.920 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:58:27.920 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-14T10:58:27.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:58:27.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-14T10:58:27.921 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-14T10:58:28.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:58:28.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:58:28.042 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-14T10:58:28.042 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:58:28.042 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-14T10:58:28.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-14T10:58:28.042 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T10:58:28.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-14T10:58:28.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-14T10:58:28.043 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-14T10:58:28.043 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-14T10:58:28.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:58:28.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:58:28.177 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:58:28.178 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-04-14T10:58:28.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-04-14T10:58:28.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T10:58:28.178 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-04-14T10:58:28.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:58:28.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:58:28.260 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-14T10:58:28.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T10:58:28.260 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:28.275 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:58:28.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T10:58:28.275 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:28.328 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-04-14T10:58:28.396 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-04-14T10:58:28.452 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-04-14T10:58:28.452 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-04-14T10:58:28.452 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-04-14T10:58:28.453 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2024-04-14T10:58:28.454 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2024-04-14T10:58:28.455 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2024-04-14T10:58:28.455 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-04-14T10:58:28.455 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:58:28.455 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:58:28.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:28.455 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-04-14T10:58:28.507 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-14T10:58:28.507 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-14T10:58:28.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo modprobe fuse 2024-04-14T10:58:28.575 DEBUG:teuthology.orchestra.run.smithi084:> cat /proc/self/mounts | awk '{print $2}' 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/proc 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/sys 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/dev 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/security 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/shm 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/pts 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/run 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/cgroup 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/pstore 2024-04-14T10:58:28.631 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/bpf 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/ 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/selinux 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/proc/sys/fs/binfmt_misc 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/hugepages 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/dev/mqueue 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/debug 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/tracing 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/fs/fuse/connections 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/sys/kernel/config 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-sysctl.service 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/nfs/rpc_pipefs 2024-04-14T10:58:28.632 INFO:teuthology.orchestra.run.smithi084.stdout:/run/user/1000 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-0 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-1 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-2 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/var/lib/ceph/osd/ceph-3 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run.smithi084.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:58:28.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:28.633 DEBUG:teuthology.orchestra.run.smithi084:> ls /sys/fs/fuse/connections 2024-04-14T10:58:28.634 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:2024-04-14T10:58:28.636+0000 7f157263e480 -1 init, newargv = 0x5649241ca1d0 newargc=15 2024-04-14T10:58:28.634 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[46552]: starting ceph client 2024-04-14T10:58:28.640 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi084.stderr:ceph-fuse[46552]: starting fuse 2024-04-14T10:58:28.648 INFO:teuthology.orchestra.run.smithi084.stdout:41 2024-04-14T10:58:28.649 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> sudo stdin-killer -- python3 -c ' 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> import glob 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> import re 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> import os 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> import subprocess 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> def _find_admin_socket(client_name): 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> files = glob.glob(asok_path) 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-14T10:58:28.649 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> # Given a non-glob path, it better be there 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> if "*" not in asok_path: 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> assert(len(files) == 1) 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> return files[0] 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> for f in files: 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> contents = proc_f.read() 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> if mountpoint in contents: 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> return f 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> print(_find_admin_socket("client.0")) 2024-04-14T10:58:28.650 DEBUG:teuthology.orchestra.run.smithi084:> ' 2024-04-14T10:58:28.769 INFO:teuthology.orchestra.run.smithi084.stdout:/var/run/ceph/ceph-client.0.46552.asok 2024-04-14T10:58:28.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:58:28.780 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46552.asok 2024-04-14T10:58:28.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:28.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46552.asok status 2024-04-14T10:58:28.915 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:28.915 INFO:teuthology.orchestra.run.smithi084.stdout: "metadata": { 2024-04-14T10:58:28.915 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_sha1": "605eb1656ce49fe7fede4f53b18852ac638918c7", 2024-04-14T10:58:28.915 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.0.0-2765-g605eb165 (605eb1656ce49fe7fede4f53b18852ac638918c7) squid (dev)", 2024-04-14T10:58:28.915 INFO:teuthology.orchestra.run.smithi084.stdout: "entity_id": "0", 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": "smithi084", 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "pid": "46552", 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "root": "/" 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_count": 0, 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "dentry_pinned_count": 0, 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4785, 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "inst": { 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "name": { 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "client", 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "num": 4785 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T10:58:28.916 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2781834109 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": { 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "192.168.0.1:0", 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2781834109 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "inst_str": "client.4785 192.168.0.1:0/2781834109", 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "addr_str": "192.168.0.1:0/2781834109", 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "inode_count": 1, 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_epoch": 13, 2024-04-14T10:58:28.917 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch": 20, 2024-04-14T10:58:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_epoch_barrier": 0, 2024-04-14T10:58:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: "blocklisted": false, 2024-04-14T10:58:28.918 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs" 2024-04-14T10:58:28.918 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:28.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:28.923 DEBUG:teuthology.orchestra.run.smithi084:> stat --file-system '--printf=%T 2024-04-14T10:58:28.923 DEBUG:teuthology.orchestra.run.smithi084:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:28.938 INFO:teuthology.orchestra.run.smithi084.stdout:fuseblk 2024-04-14T10:58:28.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:28.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:58:28.939 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:29.010 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-14T10:58:29.036 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:29.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.152+0000 7fe29011e640 1 Processor -- start 2024-04-14T10:58:29.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.152+0000 7fe29011e640 1 -- start start 2024-04-14T10:58:29.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe29011e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2880b3930 0x7fe28815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe29011e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe28815b500 0x7fe2880cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe29011e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28815b950 con 0x7fe288155160 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe29011e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880ccd90 con 0x7fe28815b500 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe29011e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe28815e4d0 con 0x7fe2880b3930 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe28815b500 0x7fe2880cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe28815b500 0x7fe2880cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41788/0 (socket says 172.21.15.84:41788) 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 -- 172.21.15.84:0/385855836 learned_addr learned my addr 172.21.15.84:0/385855836 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28d6b9640 1 --2- 172.21.15.84:0/385855836 >> v2:172.21.15.175:3300/0 conn(0x7fe2880b3930 0x7fe28815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 -- 172.21.15.84:0/385855836 >> v2:172.21.15.175:3300/0 conn(0x7fe2880b3930 msgr2=0x7fe28815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 --2- 172.21.15.84:0/385855836 >> v2:172.21.15.175:3300/0 conn(0x7fe2880b3930 0x7fe28815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 -- 172.21.15.84:0/385855836 >> v1:172.21.15.84:6789/0 conn(0x7fe288155160 legacy=0x7fe2880cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28ceb8640 1 -- 172.21.15.84:0/385855836 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231347179 0 0) 0x7fe28815b950 con 0x7fe288155160 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.153+0000 7fe28e6bb640 1 -- 172.21.15.84:0/385855836 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28815e7b0 con 0x7fe28815b500 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.154+0000 7fe28e6bb640 1 --2- 172.21.15.84:0/385855836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe28815b500 0x7fe2880cc150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2880c4150 tx=0x7fe28002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d00fe7564821b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.154+0000 7fe28ceb8640 1 -- 172.21.15.84:0/385855836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28002cbb0 con 0x7fe28815b500 2024-04-14T10:58:29.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.154+0000 7fe28ceb8640 1 -- 172.21.15.84:0/385855836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe28002cd50 con 0x7fe28815b500 2024-04-14T10:58:29.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.154+0000 7fe28ceb8640 1 -- 172.21.15.84:0/385855836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280034610 con 0x7fe28815b500 2024-04-14T10:58:29.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 -- 172.21.15.84:0/385855836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe28815b500 msgr2=0x7fe2880cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 --2- 172.21.15.84:0/385855836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe28815b500 0x7fe2880cc150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2880c4150 tx=0x7fe28002c010 comp rx=0 tx=0).stop 2024-04-14T10:58:29.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 -- 172.21.15.84:0/385855836 shutdown_connections 2024-04-14T10:58:29.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 --2- 172.21.15.84:0/385855836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe28815b500 0x7fe2880cc150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 --2- 172.21.15.84:0/385855836 >> v2:172.21.15.175:3300/0 conn(0x7fe2880b3930 0x7fe28815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 -- 172.21.15.84:0/385855836 >> 172.21.15.84:0/385855836 conn(0x7fe28806b900 msgr2=0x7fe28806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 -- 172.21.15.84:0/385855836 shutdown_connections 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.155+0000 7fe29011e640 1 -- 172.21.15.84:0/385855836 wait complete. 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 Processor -- start 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 -- start start 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 0x7fe288153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe288155160 0x7fe2881505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe28815b500 0x7fe2880cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe28815f050 con 0x7fe2880b3930 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe28815ed70 con 0x7fe288155160 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.156+0000 7fe29011e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe288155540 con 0x7fe28815b500 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 0x7fe288153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 0x7fe288153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41792/0 (socket says 172.21.15.84:41792) 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 -- 172.21.15.84:0/3657464005 learned_addr learned my addr 172.21.15.84:0/3657464005 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28d6b9640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe288155160 0x7fe2881505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28e6bb640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe28815b500 0x7fe2880cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 -- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe28815b500 msgr2=0x7fe2880cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe28815b500 0x7fe2880cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 -- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe288155160 msgr2=0x7fe2881505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe288155160 0x7fe2881505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 -- 172.21.15.84:0/3657464005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2881f0660 con 0x7fe2880b3930 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28d6b9640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe288155160 0x7fe2881505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe28deba640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 0x7fe288153280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c4e0 tx=0x7fe28400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284017070 con 0x7fe2880b3930 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2840035f0 con 0x7fe2880b3930 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2840039e0 con 0x7fe2880b3930 2024-04-14T10:58:29.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2881f0940 con 0x7fe2880b3930 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.157+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881f0f00 con 0x7fe2880b3930 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.158+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe288069c30 con 0x7fe2880b3930 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.159+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe28401a070 con 0x7fe2880b3930 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.159+0000 7fe27e7fc640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe26c06c920 0x7fe26c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.159+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe28408ae50 con 0x7fe2880b3930 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.159+0000 7fe28d6b9640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe26c06c920 0x7fe26c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.159+0000 7fe28d6b9640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe26c06c920 0x7fe26c06ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2880d0070 tx=0x7fe278008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.164+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fe284058c30 con 0x7fe2880b3930 2024-04-14T10:58:29.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.343+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2880c3890 con 0x7fe2880b3930 2024-04-14T10:58:29.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.344+0000 7fe27e7fc640 1 -- 172.21.15.84:0/3657464005 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7fe28405cf30 con 0x7fe2880b3930 2024-04-14T10:58:29.343 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:29.343 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe26c06c920 msgr2=0x7fe26c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe26c06c920 0x7fe26c06ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2880d0070 tx=0x7fe278008040 comp rx=0 tx=0).stop 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 msgr2=0x7fe288153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 0x7fe288153280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c4e0 tx=0x7fe28400c9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 shutdown_connections 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe26c06c920 0x7fe26c06ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe28815b500 0x7fe2880cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe288155160 0x7fe2881505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 --2- 172.21.15.84:0/3657464005 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe2880b3930 0x7fe288153280 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 >> 172.21.15.84:0/3657464005 conn(0x7fe28806b900 msgr2=0x7fe2880b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 shutdown_connections 2024-04-14T10:58:29.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.346+0000 7fe29011e640 1 -- 172.21.15.84:0/3657464005 wait complete. 2024-04-14T10:58:29.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:58:29.356 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:58:29.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.461+0000 7f9017436640 1 Processor -- start 2024-04-14T10:58:29.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.461+0000 7f9017436640 1 -- start start 2024-04-14T10:58:29.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f9017436640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90100ccfd0 0x7f9010154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f9017436640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901015e910 con 0x7f90100ccbf0 2024-04-14T10:58:29.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f9017436640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901015ebf0 con 0x7f901015e3b0 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f9017436640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f90100c45f0 con 0x7f90100ccfd0 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f90149d1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f90100ccfd0 0x7f9010154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f90151d2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f90100ccbf0 0x7f90100c4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52334/0 (socket says 172.21.15.84:52334) 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f90151d2640 1 -- 172.21.15.84:0/1919574432 learned_addr learned my addr 172.21.15.84:0/1919574432 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f90149d1640 1 -- 172.21.15.84:0/1919574432 >> v1:172.21.15.175:6789/0 conn(0x7f901015e3b0 legacy=0x7f90100c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f90149d1640 1 -- 172.21.15.84:0/1919574432 >> v1:172.21.15.84:6789/0 conn(0x7f90100ccbf0 legacy=0x7f90100c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f90149d1640 1 -- 172.21.15.84:0/1919574432 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901015eed0 con 0x7f90100ccfd0 2024-04-14T10:58:29.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.462+0000 7f9007fff640 1 -- 172.21.15.84:0/1919574432 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499819602 0 0) 0x7f901015e910 con 0x7f90100ccbf0 2024-04-14T10:58:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.463+0000 7f90149d1640 1 --2- 172.21.15.84:0/1919574432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccfd0 0x7f9010154c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90000097a0 tx=0x7f900002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a574e4c6a4de6bc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.463+0000 7f9007fff640 1 -- 172.21.15.84:0/1919574432 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000034070 con 0x7f90100ccfd0 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.463+0000 7f9007fff640 1 -- 172.21.15.84:0/1919574432 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9000030610 con 0x7f90100ccfd0 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.463+0000 7f9007fff640 1 -- 172.21.15.84:0/1919574432 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000309e0 con 0x7f90100ccfd0 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 -- 172.21.15.84:0/1919574432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccfd0 msgr2=0x7f9010154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 --2- 172.21.15.84:0/1919574432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccfd0 0x7f9010154c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f90000097a0 tx=0x7f900002b960 comp rx=0 tx=0).stop 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 -- 172.21.15.84:0/1919574432 shutdown_connections 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 --2- 172.21.15.84:0/1919574432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccfd0 0x7f9010154c80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 -- 172.21.15.84:0/1919574432 >> 172.21.15.84:0/1919574432 conn(0x7f9010067900 msgr2=0x7f901006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 -- 172.21.15.84:0/1919574432 shutdown_connections 2024-04-14T10:58:29.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.464+0000 7f9017436640 1 -- 172.21.15.84:0/1919574432 wait complete. 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 Processor -- start 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 -- start start 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 0x7f901006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90100ccfd0 0x7f901014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901015e3b0 0x7f90101f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f90100c5190 con 0x7f90100ccbf0 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f901015f1b0 con 0x7f901015e3b0 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.465+0000 7f9017436640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f90100c5310 con 0x7f90100ccfd0 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 0x7f901006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 0x7f901006c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41796/0 (socket says 172.21.15.84:41796) 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 -- 172.21.15.84:0/1171177829 learned_addr learned my addr 172.21.15.84:0/1171177829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90159d3640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901015e3b0 0x7f90101f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90149d1640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90100ccfd0 0x7f901014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 -- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90100ccfd0 msgr2=0x7f901014ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90100ccfd0 0x7f901014ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 -- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901015e3b0 msgr2=0x7f90101f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901015e3b0 0x7f90101f0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 -- 172.21.15.84:0/1171177829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9010151b00 con 0x7f90100ccbf0 2024-04-14T10:58:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90149d1640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90100ccfd0 0x7f901014ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f90151d2640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 0x7f901006c8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c500 tx=0x7f900c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c018070 con 0x7f90100ccbf0 2024-04-14T10:58:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f900c007580 con 0x7f90100ccbf0 2024-04-14T10:58:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c004a20 con 0x7f90100ccbf0 2024-04-14T10:58:29.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901006baa0 con 0x7f90100ccbf0 2024-04-14T10:58:29.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.466+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901014ffd0 con 0x7f90100ccbf0 2024-04-14T10:58:29.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.467+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9010069b20 con 0x7f90100ccbf0 2024-04-14T10:58:29.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.468+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f900c01b070 con 0x7f90100ccbf0 2024-04-14T10:58:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.468+0000 7f9005ffb640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8ff406c8f0 0x7f8ff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.468+0000 7f90149d1640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8ff406c8f0 0x7f8ff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.468+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f900c08ae20 con 0x7f90100ccbf0 2024-04-14T10:58:29.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.469+0000 7f90149d1640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8ff406c8f0 0x7f8ff406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9000036000 tx=0x7f900003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.474+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f900c0592e0 con 0x7f90100ccbf0 2024-04-14T10:58:29.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.648+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f901015bc60 con 0x7f90100ccbf0 2024-04-14T10:58:29.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.649+0000 7f9005ffb640 1 -- 172.21.15.84:0/1171177829 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f900c058be0 con 0x7f90100ccbf0 2024-04-14T10:58:29.652 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8ff406c8f0 msgr2=0x7f8ff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8ff406c8f0 0x7f8ff406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9000036000 tx=0x7f900003b040 comp rx=0 tx=0).stop 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 msgr2=0x7f901006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 0x7f901006c8a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c500 tx=0x7f900c00c9c0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 shutdown_connections 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f8ff406c8f0 0x7f8ff406edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f901015e3b0 0x7f90101f0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90100ccfd0 0x7f901014ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 --2- 172.21.15.84:0/1171177829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f90100ccbf0 0x7f901006c8a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 >> 172.21.15.84:0/1171177829 conn(0x7f9010067900 msgr2=0x7f901015c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 shutdown_connections 2024-04-14T10:58:29.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.651+0000 7f9017436640 1 -- 172.21.15.84:0/1171177829 wait complete. 2024-04-14T10:58:29.660 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:58:29.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.764+0000 7f7430b15640 1 Processor -- start 2024-04-14T10:58:29.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.764+0000 7f7430b15640 1 -- start start 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7430b15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f742c155060 0x7f742c15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7430b15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 0x7f742c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7430b15640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f742c15f240 con 0x7f742c0cd4f0 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7430b15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f742c0cbe50 con 0x7f742c155060 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7430b15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f742c06c560 con 0x7f742c0cafb0 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f742ad9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f742c0cd4f0 0x7f742c0cc2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52346/0 (socket says 172.21.15.84:52346) 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f742ad9d640 1 -- 172.21.15.84:0/1327685814 learned_addr learned my addr 172.21.15.84:0/1327685814 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453975773 0 0) 0x7f742c15f240 con 0x7f742c0cd4f0 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7418003520 con 0x7f742c0cd4f0 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f742a59c640 1 --2- 172.21.15.84:0/1327685814 >> v2:172.21.15.175:3300/0 conn(0x7f742c155060 0x7f742c15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7423fff640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 0x7f742c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203266626 0 0) 0x7f7418003520 con 0x7f742c0cd4f0 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 msgr2=0x7f742c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 0x7f742c0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 >> v2:172.21.15.175:3300/0 conn(0x7f742c155060 msgr2=0x7f742c15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 --2- 172.21.15.84:0/1327685814 >> v2:172.21.15.175:3300/0 conn(0x7f742c155060 0x7f742c15ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c155440 con 0x7f742c0cd4f0 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7f74240019f0 con 0x7f742c0cd4f0 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 >> v1:172.21.15.84:6789/0 conn(0x7f742c0cd4f0 legacy=0x7f742c0cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f7418003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7418004800 0x7f7418004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 0x7f74180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f742c0cbe50 con 0x7f74180039b0 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f742c06c560 con 0x7f7418004800 2024-04-14T10:58:29.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f741800b9c0 con 0x7f742c0cafb0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.765+0000 7f742a59c640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f7418003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f7423fff640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7418004800 0x7f7418004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f742ad9d640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 0x7f74180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f742a59c640 1 -- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 msgr2=0x7f74180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f742a59c640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0cafb0 0x7f74180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f742a59c640 1 -- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7418004800 msgr2=0x7f7418004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f742a59c640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7418004800 0x7f7418004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.766+0000 7f742a59c640 1 -- 172.21.15.84:0/1327685814 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7418003520 con 0x7f74180039b0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f742a59c640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f7418003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f741c009ac0 tx=0x7f7418005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebde551ff3d7bf54 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c039070 con 0x7f74180039b0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c02c710 con 0x7f74180039b0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7429d9b640 1 -- 172.21.15.84:0/1327685814 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c009690 con 0x7f74180039b0 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7430b15640 1 -- 172.21.15.84:0/1327685814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 msgr2=0x7f7418003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7430b15640 1 --2- 172.21.15.84:0/1327685814 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f7418003dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f741c009ac0 tx=0x7f7418005830 comp rx=0 tx=0).stop 2024-04-14T10:58:29.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f742ad9d640 1 -- 172.21.15.84:0/1327685814 reap_dead start 2024-04-14T10:58:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7430b15640 1 -- 172.21.15.84:0/1327685814 shutdown_connections 2024-04-14T10:58:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7430b15640 1 -- 172.21.15.84:0/1327685814 >> 172.21.15.84:0/1327685814 conn(0x7f742c067720 msgr2=0x7f742c06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7430b15640 1 -- 172.21.15.84:0/1327685814 shutdown_connections 2024-04-14T10:58:29.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.767+0000 7f7430b15640 1 -- 172.21.15.84:0/1327685814 wait complete. 2024-04-14T10:58:29.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 Processor -- start 2024-04-14T10:58:29.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 -- start start 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f742c0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c157ca0 0x7f742c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0d0090 0x7f742c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f742c15b5d0 con 0x7f74180039b0 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f742c15b2f0 con 0x7f742c157ca0 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7430b15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f742c15b8b0 con 0x7f742c0d0090 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f742a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f742c0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f742a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f742c0cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41808/0 (socket says 172.21.15.84:41808) 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f742a59c640 1 -- 172.21.15.84:0/2135519998 learned_addr learned my addr 172.21.15.84:0/2135519998 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f742ad9d640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0d0090 0x7f742c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.769+0000 7f7423fff640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c157ca0 0x7f742c1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f742a59c640 1 -- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0d0090 msgr2=0x7f742c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f742a59c640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0d0090 0x7f742c0d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f742a59c640 1 -- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c157ca0 msgr2=0x7f742c1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f742a59c640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c157ca0 0x7f742c1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f742a59c640 1 -- 172.21.15.84:0/2135519998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c0d0a50 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f7423fff640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c157ca0 0x7f742c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f742a59c640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f742c0cf2d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f741c037040 tx=0x7f741c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c039050 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c045070 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742c0ce590 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c003a50 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.770+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742c1567d0 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.771+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742c069b20 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.771+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f741c003bf0 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.772+0000 7f7422ffd640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740c06c8f0 0x7f740c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.772+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f741c0ad6c0 con 0x7f74180039b0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.772+0000 7f7423fff640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740c06c8f0 0x7f740c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:29.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.772+0000 7f7423fff640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740c06c8f0 0x7f740c06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f742c0caae0 tx=0x7f7414008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.776+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f741c04e020 con 0x7f74180039b0 2024-04-14T10:58:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.949+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f742c152090 con 0x7f74180039b0 2024-04-14T10:58:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.949+0000 7f7422ffd640 1 -- 172.21.15.84:0/2135519998 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f742c0d0a50 con 0x7f74180039b0 2024-04-14T10:58:29.948 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740c06c8f0 msgr2=0x7f740c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740c06c8f0 0x7f740c06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f742c0caae0 tx=0x7f7414008040 comp rx=0 tx=0).stop 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 msgr2=0x7f742c0cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f742c0cf2d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f741c037040 tx=0x7f741c004730 comp rx=0 tx=0).stop 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 shutdown_connections 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f740c06c8f0 0x7f740c06edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f742c0d0090 0x7f742c0d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f742c157ca0 0x7f742c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 --2- 172.21.15.84:0/2135519998 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f74180039b0 0x7f742c0cf2d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 >> 172.21.15.84:0/2135519998 conn(0x7f742c067720 msgr2=0x7f742c0cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 shutdown_connections 2024-04-14T10:58:29.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:29.951+0000 7f7430b15640 1 -- 172.21.15.84:0/2135519998 wait complete. 2024-04-14T10:58:29.960 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:58:30.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.065+0000 7f9f98555640 1 Processor -- start 2024-04-14T10:58:30.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.065+0000 7f9f98555640 1 -- start start 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f98555640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f900ccbf0 0x7f9f900c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f98555640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f9015e3b0 0x7f9f900c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f98555640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f9015e910 con 0x7f9f900ccfd0 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f98555640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9f900c45f0 con 0x7f9f900ccbf0 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f98555640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9f9015ebf0 con 0x7f9f9015e3b0 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f900ccbf0 0x7f9f900c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9f900ccbf0 0x7f9f900c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41812/0 (socket says 172.21.15.84:41812) 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 -- 172.21.15.84:0/2690449014 learned_addr learned my addr 172.21.15.84:0/2690449014 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f96af2640 1 --2- 172.21.15.84:0/2690449014 >> v2:172.21.15.175:3300/0 conn(0x7f9f9015e3b0 0x7f9f900c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 -- 172.21.15.84:0/2690449014 >> v2:172.21.15.175:3300/0 conn(0x7f9f9015e3b0 msgr2=0x7f9f900c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 --2- 172.21.15.84:0/2690449014 >> v2:172.21.15.175:3300/0 conn(0x7f9f9015e3b0 0x7f9f900c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 -- 172.21.15.84:0/2690449014 >> v1:172.21.15.175:6789/0 conn(0x7f9f900ccfd0 legacy=0x7f9f90154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f962f1640 1 -- 172.21.15.84:0/2690449014 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9015eed0 con 0x7f9f900ccbf0 2024-04-14T10:58:30.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.066+0000 7f9f96af2640 1 --2- 172.21.15.84:0/2690449014 >> v2:172.21.15.175:3300/0 conn(0x7f9f9015e3b0 0x7f9f900c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:30.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.067+0000 7f9f962f1640 1 --2- 172.21.15.84:0/2690449014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccbf0 0x7f9f900c4a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f900c8c20 tx=0x7f9f8c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47e7d5366b53e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.067+0000 7f9f952ef640 1 -- 172.21.15.84:0/2690449014 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c02cb20 con 0x7f9f900ccbf0 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.067+0000 7f9f952ef640 1 -- 172.21.15.84:0/2690449014 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f8c02ccc0 con 0x7f9f900ccbf0 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.067+0000 7f9f952ef640 1 -- 172.21.15.84:0/2690449014 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c034610 con 0x7f9f900ccbf0 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 -- 172.21.15.84:0/2690449014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccbf0 msgr2=0x7f9f900c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 --2- 172.21.15.84:0/2690449014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccbf0 0x7f9f900c4a80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f900c8c20 tx=0x7f9f8c02bf80 comp rx=0 tx=0).stop 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 -- 172.21.15.84:0/2690449014 shutdown_connections 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 --2- 172.21.15.84:0/2690449014 >> v2:172.21.15.175:3300/0 conn(0x7f9f9015e3b0 0x7f9f900c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 --2- 172.21.15.84:0/2690449014 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccbf0 0x7f9f900c4a80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 -- 172.21.15.84:0/2690449014 >> 172.21.15.84:0/2690449014 conn(0x7f9f90067900 msgr2=0x7f9f9006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 -- 172.21.15.84:0/2690449014 shutdown_connections 2024-04-14T10:58:30.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.068+0000 7f9f98555640 1 -- 172.21.15.84:0/2690449014 wait complete. 2024-04-14T10:58:30.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.069+0000 7f9f98555640 1 Processor -- start 2024-04-14T10:58:30.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.069+0000 7f9f98555640 1 -- start start 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f900ccbf0 0x7f9f9014c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 0x7f9f901f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015e3b0 0x7f9f901f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9f90155390 con 0x7f9f900ccfd0 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9015f1b0 con 0x7f9f9015e3b0 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9f90155510 con 0x7f9f900ccbf0 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 0x7f9f901f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 0x7f9f901f0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41814/0 (socket says 172.21.15.84:41814) 2024-04-14T10:58:30.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 -- 172.21.15.84:0/3830127726 learned_addr learned my addr 172.21.15.84:0/3830127726 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f962f1640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f900ccbf0 0x7f9f9014c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f96af2640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015e3b0 0x7f9f901f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 -- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f900ccbf0 msgr2=0x7f9f9014c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f900ccbf0 0x7f9f9014c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 -- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015e3b0 msgr2=0x7f9f901f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015e3b0 0x7f9f901f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 -- 172.21.15.84:0/3830127726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f901f0740 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f95af0640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 0x7f9f901f0c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c400 tx=0x7f9f8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80011790 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f80017070 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9015d780 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80011bb0 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.070+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f9015dd40 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.071+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f90069b20 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.072+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f8001c460 con 0x7f9f900ccfd0 2024-04-14T10:58:30.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.072+0000 7f9f86ffd640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f7406c8f0 0x7f9f7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.072+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9f8008b950 con 0x7f9f900ccfd0 2024-04-14T10:58:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.072+0000 7f9f962f1640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f7406c8f0 0x7f9f7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.073+0000 7f9f962f1640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f7406c8f0 0x7f9f7406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c035000 tx=0x7f9f8c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.077+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f9f80059690 con 0x7f9f900ccfd0 2024-04-14T10:58:30.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.251+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f901f0910 con 0x7f9f900ccfd0 2024-04-14T10:58:30.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.251+0000 7f9f86ffd640 1 -- 172.21.15.84:0/3830127726 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f9f8005d990 con 0x7f9f900ccfd0 2024-04-14T10:58:30.250 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f7406c8f0 msgr2=0x7f9f7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f7406c8f0 0x7f9f7406edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c035000 tx=0x7f9f8c030000 comp rx=0 tx=0).stop 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 msgr2=0x7f9f901f0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 0x7f9f901f0c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c400 tx=0x7f9f8000c8c0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 shutdown_connections 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f7406c8f0 0x7f9f7406edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015e3b0 0x7f9f901f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f900ccfd0 0x7f9f901f0c20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 --2- 172.21.15.84:0/3830127726 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f900ccbf0 0x7f9f9014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 >> 172.21.15.84:0/3830127726 conn(0x7f9f90067900 msgr2=0x7f9f90154980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 shutdown_connections 2024-04-14T10:58:30.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.253+0000 7f9f98555640 1 -- 172.21.15.84:0/3830127726 wait complete. 2024-04-14T10:58:30.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:30.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.364+0000 7f338855e640 1 Processor -- start 2024-04-14T10:58:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.364+0000 7f338855e640 1 -- start start 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f338855e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33801551d0 0x7f338006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f338855e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338015acd0 con 0x7f338015cdf0 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f338855e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338015af70 con 0x7f33800ce320 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f338855e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f338015b210 con 0x7f33801551d0 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f3386afb640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f338015cdf0 0x7f3380165650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52360/0 (socket says 172.21.15.84:52360) 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f3386afb640 1 -- 172.21.15.84:0/3973547309 learned_addr learned my addr 172.21.15.84:0/3973547309 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33862fa640 1 --2- 172.21.15.84:0/3973547309 >> v2:172.21.15.175:3300/0 conn(0x7f33801551d0 0x7f338006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81077279 0 0) 0x7f338015acd0 con 0x7f338015cdf0 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f336c003520 con 0x7f338015cdf0 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794073701 0 0) 0x7f338015af70 con 0x7f33800ce320 2024-04-14T10:58:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f338015acd0 con 0x7f33800ce320 2024-04-14T10:58:30.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2514321321 0 0) 0x7f336c003520 con 0x7f338015cdf0 2024-04-14T10:58:30.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33862fa640 1 -- 172.21.15.84:0/3973547309 >> v1:172.21.15.175:6789/0 conn(0x7f33800ce320 legacy=0x7f338015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33862fa640 1 -- 172.21.15.84:0/3973547309 >> v1:172.21.15.84:6789/0 conn(0x7f338015cdf0 legacy=0x7f3380165650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.365+0000 7f33862fa640 1 -- 172.21.15.84:0/3973547309 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338015b4f0 con 0x7f33801551d0 2024-04-14T10:58:30.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.366+0000 7f33862fa640 1 --2- 172.21.15.84:0/3973547309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33801551d0 0x7f338006faf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f337c0097a0 tx=0x7f337c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2077a8e91e06b2f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.366+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33780019f0 con 0x7f33801551d0 2024-04-14T10:58:30.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.366+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c037070 con 0x7f33801551d0 2024-04-14T10:58:30.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.366+0000 7f33852f8640 1 -- 172.21.15.84:0/3973547309 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c031790 con 0x7f33801551d0 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 -- 172.21.15.84:0/3973547309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33801551d0 msgr2=0x7f338006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 --2- 172.21.15.84:0/3973547309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33801551d0 0x7f338006faf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f337c0097a0 tx=0x7f337c02b8b0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 -- 172.21.15.84:0/3973547309 shutdown_connections 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 --2- 172.21.15.84:0/3973547309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33801551d0 0x7f338006faf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 -- 172.21.15.84:0/3973547309 >> 172.21.15.84:0/3973547309 conn(0x7f338006db10 msgr2=0x7f338006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 -- 172.21.15.84:0/3973547309 shutdown_connections 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.367+0000 7f338855e640 1 -- 172.21.15.84:0/3973547309 wait complete. 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.368+0000 7f338855e640 1 Processor -- start 2024-04-14T10:58:30.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.368+0000 7f338855e640 1 -- start start 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f338855e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 0x7f3380151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f338855e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33801551d0 0x7f33801f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f338855e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f338015cdf0 0x7f3380153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f338855e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f338015c1c0 con 0x7f33800ce320 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f338855e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f338015bab0 con 0x7f338015cdf0 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f338855e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33800c8d90 con 0x7f33801551d0 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 0x7f3380151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 0x7f3380151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41830/0 (socket says 172.21.15.84:41830) 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 -- 172.21.15.84:0/730299963 learned_addr learned my addr 172.21.15.84:0/730299963 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f3386afb640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f338015cdf0 0x7f3380153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f3385af9640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33801551d0 0x7f33801f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 -- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33801551d0 msgr2=0x7f33801f4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33801551d0 0x7f33801f4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 -- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f338015cdf0 msgr2=0x7f3380153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f338015cdf0 0x7f3380153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 -- 172.21.15.84:0/730299963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3380151f60 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f3386afb640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f338015cdf0 0x7f3380153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f33862fa640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 0x7f3380151a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f337c0098c0 tx=0x7f337c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.369+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c003b20 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.370+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c003cc0 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.370+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33800cab70 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.370+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c031790 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.370+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33800cb0f0 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.370+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3380069c30 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.371+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f337c031930 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.371+0000 7f3376ffd640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f336406c8f0 0x7f336406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.371+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f337c0adce0 con 0x7f33800ce320 2024-04-14T10:58:30.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.371+0000 7f3385af9640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f336406c8f0 0x7f336406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.372+0000 7f3385af9640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f336406c8f0 0x7f336406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3380153fa0 tx=0x7f3370009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.376+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f337c07c120 con 0x7f33800ce320 2024-04-14T10:58:30.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.552+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f338006f8b0 con 0x7f33800ce320 2024-04-14T10:58:30.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.553+0000 7f3376ffd640 1 -- 172.21.15.84:0/730299963 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f337c09b0c0 con 0x7f33800ce320 2024-04-14T10:58:30.552 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:30.552 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f336406c8f0 msgr2=0x7f336406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f336406c8f0 0x7f336406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3380153fa0 tx=0x7f3370009040 comp rx=0 tx=0).stop 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 msgr2=0x7f3380151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 0x7f3380151a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f337c0098c0 tx=0x7f337c0046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 shutdown_connections 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f336406c8f0 0x7f336406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f338015cdf0 0x7f3380153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33801551d0 0x7f33801f4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 --2- 172.21.15.84:0/730299963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33800ce320 0x7f3380151a20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 >> 172.21.15.84:0/730299963 conn(0x7f338006db10 msgr2=0x7f338006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 shutdown_connections 2024-04-14T10:58:30.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.555+0000 7f338855e640 1 -- 172.21.15.84:0/730299963 wait complete. 2024-04-14T10:58:30.564 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:58:30.565 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:58:30.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.670+0000 7f7fb5f8c640 1 Processor -- start 2024-04-14T10:58:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.670+0000 7f7fb5f8c640 1 -- start start 2024-04-14T10:58:30.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7fb5f8c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fb0153290 0x7f7fb015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7fb5f8c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb00c3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7fb5f8c640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb015d3c0 con 0x7f7fb006c420 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7fb5f8c640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb0159ba0 con 0x7f7fb0153290 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7fb5f8c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb00caa90 con 0x7f7fb00ca530 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faf7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7fb0153290 0x7f7fb015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faeffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7fb006c420 0x7f7fb006b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52370/0 (socket says 172.21.15.84:52370) 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faeffd640 1 -- 172.21.15.84:0/17072482 learned_addr learned my addr 172.21.15.84:0/17072482 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faffff640 1 --2- 172.21.15.84:0/17072482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb00c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faf7fe640 1 -- 172.21.15.84:0/17072482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 msgr2=0x7f7fb00c3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faf7fe640 1 --2- 172.21.15.84:0/17072482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb00c3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faf7fe640 1 -- 172.21.15.84:0/17072482 >> v1:172.21.15.84:6789/0 conn(0x7f7fb006c420 legacy=0x7f7fb006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7fae7fc640 1 -- 172.21.15.84:0/17072482 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143049173 0 0) 0x7f7fb015d3c0 con 0x7f7fb006c420 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.671+0000 7f7faf7fe640 1 -- 172.21.15.84:0/17072482 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb0158f90 con 0x7f7fb0153290 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.672+0000 7f7faf7fe640 1 --2- 172.21.15.84:0/17072482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb015ce80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00097a0 tx=0x7f7fa002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b05f72bdd47893 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.672+0000 7f7fae7fc640 1 -- 172.21.15.84:0/17072482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0034070 con 0x7f7fb0153290 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.672+0000 7f7fae7fc640 1 -- 172.21.15.84:0/17072482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa0030610 con 0x7f7fb0153290 2024-04-14T10:58:30.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.672+0000 7f7fae7fc640 1 -- 172.21.15.84:0/17072482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00309e0 con 0x7f7fb0153290 2024-04-14T10:58:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/17072482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 msgr2=0x7f7fb015ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/17072482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb015ce80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00097a0 tx=0x7f7fa002b960 comp rx=0 tx=0).stop 2024-04-14T10:58:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/17072482 shutdown_connections 2024-04-14T10:58:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/17072482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb00c3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/17072482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb015ce80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/17072482 >> 172.21.15.84:0/17072482 conn(0x7f7fb00c8e60 msgr2=0x7f7fb00c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/17072482 shutdown_connections 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.673+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/17072482 wait complete. 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.674+0000 7f7fb5f8c640 1 Processor -- start 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.674+0000 7f7fb5f8c640 1 -- start start 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fb006c420 0x7f7fb015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0159830 con 0x7f7fb0153290 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0159550 con 0x7f7fb006c420 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb006c010 con 0x7f7fb00ca530 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb014fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41846/0 (socket says 172.21.15.84:41846) 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 -- 172.21.15.84:0/1088073244 learned_addr learned my addr 172.21.15.84:0/1088073244 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faf7fe640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fb006c420 0x7f7fb015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faeffd640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 -- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 msgr2=0x7f7fb014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb014f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 -- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fb006c420 msgr2=0x7f7fb015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fb006c420 0x7f7fb015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 -- 172.21.15.84:0/1088073244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb014f060 con 0x7f7fb0153290 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faeffd640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faf7fe640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fb006c420 0x7f7fb015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7faffff640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb014fa50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800efc0 tx=0x7f7fa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8018020 con 0x7f7fb0153290 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa8014480 con 0x7f7fb0153290 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb0153f50 con 0x7f7fb0153290 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8009e60 con 0x7f7fb0153290 2024-04-14T10:58:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.675+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01f13b0 con 0x7f7fb0153290 2024-04-14T10:58:30.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.676+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb0069b20 con 0x7f7fb0153290 2024-04-14T10:58:30.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.677+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fa8005d10 con 0x7f7fb0153290 2024-04-14T10:58:30.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.677+0000 7f7f97fff640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7f9c06c8f0 0x7f7f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.677+0000 7f7faf7fe640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7f9c06c8f0 0x7f7f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.677+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7fa808c910 con 0x7f7fb0153290 2024-04-14T10:58:30.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.678+0000 7f7faf7fe640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7f9c06c8f0 0x7f7f9c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0036000 tx=0x7f7fa0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.682+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f7fa8022030 con 0x7f7fb0153290 2024-04-14T10:58:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.856+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7fb00cb900 con 0x7f7fb0153290 2024-04-14T10:58:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.857+0000 7f7f97fff640 1 -- 172.21.15.84:0/1088073244 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f7fb0153f50 con 0x7f7fb0153290 2024-04-14T10:58:30.855 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:58:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.858+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7f9c06c8f0 msgr2=0x7f7f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.858+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7f9c06c8f0 0x7f7f9c06edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0036000 tx=0x7f7fa0008030 comp rx=0 tx=0).stop 2024-04-14T10:58:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.858+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 msgr2=0x7f7fb014fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.858+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb014fa50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800efc0 tx=0x7f7fa800c490 comp rx=0 tx=0).stop 2024-04-14T10:58:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.858+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 shutdown_connections 2024-04-14T10:58:30.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.858+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7f9c06c8f0 0x7f7f9c06edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.859+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fb0153290 0x7f7fb014fa50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.859+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fb00ca530 0x7f7fb014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.859+0000 7f7fb5f8c640 1 --2- 172.21.15.84:0/1088073244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fb006c420 0x7f7fb015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.859+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 >> 172.21.15.84:0/1088073244 conn(0x7f7fb00c8e60 msgr2=0x7f7fb00c3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.859+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 shutdown_connections 2024-04-14T10:58:30.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.859+0000 7f7fb5f8c640 1 -- 172.21.15.84:0/1088073244 wait complete. 2024-04-14T10:58:30.868 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:58:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.972+0000 7fe399036640 1 Processor -- start 2024-04-14T10:58:30.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.972+0000 7fe399036640 1 -- start start 2024-04-14T10:58:30.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe399036640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3940c4e60 0x7fe394157c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe399036640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe394071ad0 con 0x7fe3940c7fc0 2024-04-14T10:58:30.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe399036640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe394071db0 con 0x7fe3941513a0 2024-04-14T10:58:30.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe399036640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fe394157470 con 0x7fe3940c4e60 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe39359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3940c4e60 0x7fe394157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe39359e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fe3940c4e60 0x7fe394157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41852/0 (socket says 172.21.15.84:41852) 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe39359e640 1 -- 172.21.15.84:0/3772819539 learned_addr learned my addr 172.21.15.84:0/3772819539 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.973+0000 7fe39259c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe3940c7fc0 0x7fe39415fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52382/0 (socket says 172.21.15.84:52382) 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.974+0000 7fe39359e640 1 -- 172.21.15.84:0/3772819539 >> v1:172.21.15.175:6789/0 conn(0x7fe3941513a0 legacy=0x7fe39406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.974+0000 7fe39359e640 1 -- 172.21.15.84:0/3772819539 >> v1:172.21.15.84:6789/0 conn(0x7fe3940c7fc0 legacy=0x7fe39415fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.974+0000 7fe391d9b640 1 -- 172.21.15.84:0/3772819539 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053604571 0 0) 0x7fe394071ad0 con 0x7fe3940c7fc0 2024-04-14T10:58:30.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.974+0000 7fe39359e640 1 -- 172.21.15.84:0/3772819539 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe394157750 con 0x7fe3940c4e60 2024-04-14T10:58:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.974+0000 7fe39359e640 1 --2- 172.21.15.84:0/3772819539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3940c4e60 0x7fe394157c70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d150 tx=0x7fe38c02e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60805f9b9609e0ae server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe391d9b640 1 -- 172.21.15.84:0/3772819539 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c034070 con 0x7fe3940c4e60 2024-04-14T10:58:30.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe391d9b640 1 -- 172.21.15.84:0/3772819539 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c038400 con 0x7fe3940c4e60 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe391d9b640 1 -- 172.21.15.84:0/3772819539 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0387d0 con 0x7fe3940c4e60 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 -- 172.21.15.84:0/3772819539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3940c4e60 msgr2=0x7fe394157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 --2- 172.21.15.84:0/3772819539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3940c4e60 0x7fe394157c70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d150 tx=0x7fe38c02e200 comp rx=0 tx=0).stop 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 -- 172.21.15.84:0/3772819539 shutdown_connections 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 --2- 172.21.15.84:0/3772819539 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3940c4e60 0x7fe394157c70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 -- 172.21.15.84:0/3772819539 >> 172.21.15.84:0/3772819539 conn(0x7fe394067d50 msgr2=0x7fe39406b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 -- 172.21.15.84:0/3772819539 shutdown_connections 2024-04-14T10:58:30.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.975+0000 7fe399036640 1 -- 172.21.15.84:0/3772819539 wait complete. 2024-04-14T10:58:30.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 Processor -- start 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 -- start start 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940c4e60 0x7fe39414d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3940c7fc0 0x7fe3941e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 0x7fe3941e2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe39406fa30 con 0x7fe3941513a0 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe394151780 con 0x7fe3940c4e60 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe399036640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe39406fbb0 con 0x7fe3940c7fc0 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe39359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 0x7fe3941e2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe39359e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 0x7fe3941e2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41866/0 (socket says 172.21.15.84:41866) 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.977+0000 7fe39359e640 1 -- 172.21.15.84:0/606766928 learned_addr learned my addr 172.21.15.84:0/606766928 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39259c640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3940c7fc0 0x7fe3941e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe392d9d640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940c4e60 0x7fe39414d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39359e640 1 -- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3940c7fc0 msgr2=0x7fe3941e1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39359e640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3940c7fc0 0x7fe3941e1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39359e640 1 -- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940c4e60 msgr2=0x7fe39414d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39359e640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940c4e60 0x7fe39414d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39359e640 1 -- 172.21.15.84:0/606766928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3941e12d0 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe39359e640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 0x7fe3941e2bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d270 tx=0x7fe38c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00b720 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c00b330 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3940cb530 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c003bb0 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.978+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3940cbab0 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.979+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe394069b20 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.980+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe38c049030 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.980+0000 7fe37b7fe640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe38006c8f0 0x7fe38006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.980+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe38c0adb50 con 0x7fe3941513a0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.980+0000 7fe392d9d640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe38006c8f0 0x7fe38006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:30.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.980+0000 7fe392d9d640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe38006c8f0 0x7fe38006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe388006fd0 tx=0x7fe388009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:30.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:30.984+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fe38c050060 con 0x7fe3941513a0 2024-04-14T10:58:31.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.157+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe394154f40 con 0x7fe3941513a0 2024-04-14T10:58:31.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.157+0000 7fe37b7fe640 1 -- 172.21.15.84:0/606766928 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe38c07b9c0 con 0x7fe3941513a0 2024-04-14T10:58:31.156 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe38006c8f0 msgr2=0x7fe38006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe38006c8f0 0x7fe38006edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe388006fd0 tx=0x7fe388009060 comp rx=0 tx=0).stop 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 msgr2=0x7fe3941e2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 0x7fe3941e2bc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00d270 tx=0x7fe38c004ab0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 shutdown_connections 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe38006c8f0 0x7fe38006edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe3941513a0 0x7fe3941e2bc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3940c7fc0 0x7fe3941e1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 --2- 172.21.15.84:0/606766928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940c4e60 0x7fe39414d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 >> 172.21.15.84:0/606766928 conn(0x7fe394067d50 msgr2=0x7fe394071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 shutdown_connections 2024-04-14T10:58:31.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.159+0000 7fe399036640 1 -- 172.21.15.84:0/606766928 wait complete. 2024-04-14T10:58:31.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:58:31.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.273+0000 7efdcab5e640 1 Processor -- start 2024-04-14T10:58:31.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.273+0000 7efdcab5e640 1 -- start start 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdcab5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccbf0 0x7efdc40c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdcab5e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efdc415e3b0 0x7efdc40c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdcab5e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc415e910 con 0x7efdc40ccfd0 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdcab5e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7efdc40c45f0 con 0x7efdc415e3b0 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdcab5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efdc415ebf0 con 0x7efdc40ccbf0 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc3fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7efdc40ccfd0 0x7efdc4154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:52384/0 (socket says 172.21.15.84:52384) 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc3fff640 1 -- 172.21.15.84:0/2829423890 learned_addr learned my addr 172.21.15.84:0/2829423890 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc88fa640 1 --2- 172.21.15.84:0/2829423890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccbf0 0x7efdc40c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc90fb640 1 --2- 172.21.15.84:0/2829423890 >> v2:172.21.15.175:3300/0 conn(0x7efdc415e3b0 0x7efdc40c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc37fe640 1 -- 172.21.15.84:0/2829423890 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580820482 0 0) 0x7efdc415e910 con 0x7efdc40ccfd0 2024-04-14T10:58:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc37fe640 1 -- 172.21.15.84:0/2829423890 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdb4003520 con 0x7efdc40ccfd0 2024-04-14T10:58:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc37fe640 1 -- 172.21.15.84:0/2829423890 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1382240173 0 0) 0x7efdb4003520 con 0x7efdc40ccfd0 2024-04-14T10:58:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc88fa640 1 -- 172.21.15.84:0/2829423890 >> v2:172.21.15.175:3300/0 conn(0x7efdc415e3b0 msgr2=0x7efdc40c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc88fa640 1 --2- 172.21.15.84:0/2829423890 >> v2:172.21.15.175:3300/0 conn(0x7efdc415e3b0 0x7efdc40c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc88fa640 1 -- 172.21.15.84:0/2829423890 >> v1:172.21.15.84:6789/0 conn(0x7efdc40ccfd0 legacy=0x7efdc4154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.274+0000 7efdc88fa640 1 -- 172.21.15.84:0/2829423890 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc415eed0 con 0x7efdc40ccbf0 2024-04-14T10:58:31.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.275+0000 7efdc88fa640 1 --2- 172.21.15.84:0/2829423890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccbf0 0x7efdc40c4a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097a0 tx=0x7efdb802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d477f5d24d7b30c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.275+0000 7efdc37fe640 1 -- 172.21.15.84:0/2829423890 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8038070 con 0x7efdc40ccbf0 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.275+0000 7efdc37fe640 1 -- 172.21.15.84:0/2829423890 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb8031500 con 0x7efdc40ccbf0 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.275+0000 7efdc37fe640 1 -- 172.21.15.84:0/2829423890 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0001670 con 0x7efdc40ccbf0 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 -- 172.21.15.84:0/2829423890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccbf0 msgr2=0x7efdc40c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 --2- 172.21.15.84:0/2829423890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccbf0 0x7efdc40c4a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdb80097a0 tx=0x7efdb802b820 comp rx=0 tx=0).stop 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 -- 172.21.15.84:0/2829423890 shutdown_connections 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 --2- 172.21.15.84:0/2829423890 >> v2:172.21.15.175:3300/0 conn(0x7efdc415e3b0 0x7efdc40c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 --2- 172.21.15.84:0/2829423890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccbf0 0x7efdc40c4a80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 -- 172.21.15.84:0/2829423890 >> 172.21.15.84:0/2829423890 conn(0x7efdc4067900 msgr2=0x7efdc406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 -- 172.21.15.84:0/2829423890 shutdown_connections 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.276+0000 7efdcab5e640 1 -- 172.21.15.84:0/2829423890 wait complete. 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.277+0000 7efdcab5e640 1 Processor -- start 2024-04-14T10:58:31.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.277+0000 7efdcab5e640 1 -- start start 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 0x7efdc406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccfd0 0x7efdc41f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc415e3b0 0x7efdc4152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efdc4155390 con 0x7efdc40ccbf0 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdc415f1b0 con 0x7efdc415e3b0 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efdc4155510 con 0x7efdc40ccfd0 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 0x7efdc406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 0x7efdc406ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41868/0 (socket says 172.21.15.84:41868) 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 -- 172.21.15.84:0/3689625402 learned_addr learned my addr 172.21.15.84:0/3689625402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:31.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc3fff640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccfd0 0x7efdc41f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc90fb640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc415e3b0 0x7efdc4152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 -- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccfd0 msgr2=0x7efdc41f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccfd0 0x7efdc41f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 -- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc415e3b0 msgr2=0x7efdc4152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc415e3b0 0x7efdc4152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 -- 172.21.15.84:0/3689625402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc4159e70 con 0x7efdc40ccbf0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc90fb640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc415e3b0 0x7efdc4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc88fa640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 0x7efdc406ddb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdb802b860 tx=0x7efdb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8042070 con 0x7efdc40ccbf0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb803d870 con 0x7efdc40ccbf0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc4159260 con 0x7efdc40ccbf0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.278+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb8038040 con 0x7efdc40ccbf0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.279+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc406d7f0 con 0x7efdc40ccbf0 2024-04-14T10:58:31.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.279+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc4069b20 con 0x7efdc40ccbf0 2024-04-14T10:58:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.280+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efdb8045070 con 0x7efdc40ccbf0 2024-04-14T10:58:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.280+0000 7efdc17fa640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efda806c920 0x7efda806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.281+0000 7efdc3fff640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efda806c920 0x7efda806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.281+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efdb80ad440 con 0x7efdc40ccbf0 2024-04-14T10:58:31.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.281+0000 7efdc3fff640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efda806c920 0x7efda806ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efdb00017e0 tx=0x7efdb0001610 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.285+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7efdb804c070 con 0x7efdc40ccbf0 2024-04-14T10:58:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.460+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efdc40ce290 con 0x7efdc40ccbf0 2024-04-14T10:58:31.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.461+0000 7efdc17fa640 1 -- 172.21.15.84:0/3689625402 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7efdb8030070 con 0x7efdc40ccbf0 2024-04-14T10:58:31.459 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T10:58:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efda806c920 msgr2=0x7efda806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efda806c920 0x7efda806ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efdb00017e0 tx=0x7efdb0001610 comp rx=0 tx=0).stop 2024-04-14T10:58:31.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 msgr2=0x7efdc406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 0x7efdc406ddb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdb802b860 tx=0x7efdb80046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 shutdown_connections 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7efda806c920 0x7efda806ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdc415e3b0 0x7efdc4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdc40ccfd0 0x7efdc41f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 --2- 172.21.15.84:0/3689625402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdc40ccbf0 0x7efdc406ddb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 >> 172.21.15.84:0/3689625402 conn(0x7efdc4067900 msgr2=0x7efdc40cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 shutdown_connections 2024-04-14T10:58:31.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.463+0000 7efdcab5e640 1 -- 172.21.15.84:0/3689625402 wait complete. 2024-04-14T10:58:31.472 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-14T10:58:31.472 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:31.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.573+0000 7ff63edfe640 1 Processor -- start 2024-04-14T10:58:31.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.573+0000 7ff63edfe640 1 -- start start 2024-04-14T10:58:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63edfe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff638152bf0 0x7ff63806f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63edfe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff638152fd0 0x7ff63806f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63edfe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63806fe50 0x7ff63815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63edfe640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff638159510 con 0x7ff638152bf0 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63edfe640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff6380c8960 con 0x7ff638152fd0 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63edfe640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff638159740 con 0x7ff63806fe50 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff638152bf0 0x7ff63806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff638152bf0 0x7ff63806f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41878/0 (socket says 172.21.15.84:41878) 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 -- 172.21.15.84:0/1070291764 learned_addr learned my addr 172.21.15.84:0/1070291764 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63d39b640 1 --2- 172.21.15.84:0/1070291764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63806fe50 0x7ff63815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff637fff640 1 --2- 172.21.15.84:0/1070291764 >> v2:172.21.15.175:3300/0 conn(0x7ff638152fd0 0x7ff63806f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 -- 172.21.15.84:0/1070291764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63806fe50 msgr2=0x7ff63815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 --2- 172.21.15.84:0/1070291764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63806fe50 0x7ff63815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 -- 172.21.15.84:0/1070291764 >> v2:172.21.15.175:3300/0 conn(0x7ff638152fd0 msgr2=0x7ff63806f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 --2- 172.21.15.84:0/1070291764 >> v2:172.21.15.175:3300/0 conn(0x7ff638152fd0 0x7ff63806f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.574+0000 7ff63cb9a640 1 -- 172.21.15.84:0/1070291764 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff638159a00 con 0x7ff638152bf0 2024-04-14T10:58:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.575+0000 7ff63cb9a640 1 --2- 172.21.15.84:0/1070291764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff638152bf0 0x7ff63806f080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff638071540 tx=0x7ff62802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0db720a0ae3790 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.575+0000 7ff6377fe640 1 -- 172.21.15.84:0/1070291764 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280317c0 con 0x7ff638152bf0 2024-04-14T10:58:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.575+0000 7ff6377fe640 1 -- 172.21.15.84:0/1070291764 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff628037070 con 0x7ff638152bf0 2024-04-14T10:58:31.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.575+0000 7ff6377fe640 1 -- 172.21.15.84:0/1070291764 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628031b80 con 0x7ff638152bf0 2024-04-14T10:58:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 -- 172.21.15.84:0/1070291764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff638152bf0 msgr2=0x7ff63806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 --2- 172.21.15.84:0/1070291764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff638152bf0 0x7ff63806f080 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff638071540 tx=0x7ff62802b860 comp rx=0 tx=0).stop 2024-04-14T10:58:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 -- 172.21.15.84:0/1070291764 shutdown_connections 2024-04-14T10:58:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 --2- 172.21.15.84:0/1070291764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63806fe50 0x7ff63815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 --2- 172.21.15.84:0/1070291764 >> v2:172.21.15.175:3300/0 conn(0x7ff638152fd0 0x7ff63806f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 --2- 172.21.15.84:0/1070291764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff638152bf0 0x7ff63806f080 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 -- 172.21.15.84:0/1070291764 >> 172.21.15.84:0/1070291764 conn(0x7ff6380cc150 msgr2=0x7ff6380cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 -- 172.21.15.84:0/1070291764 shutdown_connections 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.576+0000 7ff63edfe640 1 -- 172.21.15.84:0/1070291764 wait complete. 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.577+0000 7ff63edfe640 1 Processor -- start 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.577+0000 7ff63edfe640 1 -- start start 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63edfe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 0x7ff638157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63edfe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff638152bf0 0x7ff6381eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63edfe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63814d100 0x7ff6381f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63edfe640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff63806eb60 con 0x7ff63806fe50 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63edfe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6380c8680 con 0x7ff638152bf0 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63edfe640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff6380c64f0 con 0x7ff63814d100 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 0x7ff638157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 0x7ff638157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41884/0 (socket says 172.21.15.84:41884) 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 -- 172.21.15.84:0/3010522663 learned_addr learned my addr 172.21.15.84:0/3010522663 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63d39b640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63814d100 0x7ff6381f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff637fff640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff638152bf0 0x7ff6381eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 -- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63814d100 msgr2=0x7ff6381f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63814d100 0x7ff6381f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 -- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff638152bf0 msgr2=0x7ff6381eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff638152bf0 0x7ff6381eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 -- 172.21.15.84:0/3010522663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6381f1cf0 con 0x7ff63806fe50 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff637fff640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff638152bf0 0x7ff6381eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.578+0000 7ff63cb9a640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 0x7ff638157a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff628000c00 tx=0x7ff6280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.579+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628032650 con 0x7ff63806fe50 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.579+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff628032810 con 0x7ff63806fe50 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.579+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6381ee240 con 0x7ff63806fe50 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.579+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628032c00 con 0x7ff63806fe50 2024-04-14T10:58:31.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.579+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6381f2260 con 0x7ff63806fe50 2024-04-14T10:58:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.580+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff638069c30 con 0x7ff63806fe50 2024-04-14T10:58:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.580+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6280453f0 con 0x7ff63806fe50 2024-04-14T10:58:31.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.580+0000 7ff6357fa640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff62406c8f0 0x7ff62406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.581+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff6280ad880 con 0x7ff63806fe50 2024-04-14T10:58:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.581+0000 7ff637fff640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff62406c8f0 0x7ff62406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.581+0000 7ff637fff640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff62406c8f0 0x7ff62406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff638156600 tx=0x7ff62c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.585+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff628040070 con 0x7ff63806fe50 2024-04-14T10:58:31.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.760+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6380c4cd0 con 0x7ff62406c8f0 2024-04-14T10:58:31.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.766+0000 7ff6357fa640 1 -- 172.21.15.84:0/3010522663 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7ff6380c4cd0 con 0x7ff62406c8f0 2024-04-14T10:58:31.767 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:31.768 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff62406c8f0 msgr2=0x7ff62406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff62406c8f0 0x7ff62406edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff638156600 tx=0x7ff62c008040 comp rx=0 tx=0).stop 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 msgr2=0x7ff638157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 0x7ff638157a60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff628000c00 tx=0x7ff6280046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 shutdown_connections 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff62406c8f0 0x7ff62406edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff63814d100 0x7ff6381f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff638152bf0 0x7ff6381eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 --2- 172.21.15.84:0/3010522663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff63806fe50 0x7ff638157a60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 >> 172.21.15.84:0/3010522663 conn(0x7ff6380cc150 msgr2=0x7ff638151420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:31.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 shutdown_connections 2024-04-14T10:58:31.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.769+0000 7ff63edfe640 1 -- 172.21.15.84:0/3010522663 wait complete. 2024-04-14T10:58:31.778 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-14T10:58:31.407341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2990080,"data_stored":1758652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'5","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.234221+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:14.234221+0000","last_peered":"2024-04-14T10:58:14.234221+0000","last_clean":"2024-04-14T10:58:14.234221+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:14.234221+0000","last_undegraded":"2024-04-14T10:58:14.234221+0000","last_fullsized":"2024-04-14T10:58:14.234221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253216+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:20.253216+0000","last_peered":"2024-04-14T10:58:20.253216+0000","last_clean":"2024-04-14T10:58:20.253216+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:20.253216+0000","last_undegraded":"2024-04-14T10:58:20.253216+0000","last_fullsized":"2024-04-14T10:58:20.253216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253195+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:20.253195+0000","last_peered":"2024-04-14T10:58:20.253195+0000","last_clean":"2024-04-14T10:58:20.253195+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:20.253195+0000","last_undegraded":"2024-04-14T10:58:20.253195+0000","last_fullsized":"2024-04-14T10:58:20.253195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417427+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:06.417427+0000","last_peered":"2024-04-14T10:58:06.417427+0000","last_clean":"2024-04-14T10:58:06.417427+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:06.417427+0000","last_undegraded":"2024-04-14T10:58:06.417427+0000","last_fullsized":"2024-04-14T10:58:06.417427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.234202+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:14.234202+0000","last_peered":"2024-04-14T10:58:14.234202+0000","last_clean":"2024-04-14T10:58:14.234202+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:14.234202+0000","last_undegraded":"2024-04-14T10:58:14.234202+0000","last_fullsized":"2024-04-14T10:58:14.234202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233942+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:14.233942+0000","last_peered":"2024-04-14T10:58:14.233942+0000","last_clean":"2024-04-14T10:58:14.233942+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:14.233942+0000","last_undegraded":"2024-04-14T10:58:14.233942+0000","last_fullsized":"2024-04-14T10:58:14.233942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208572+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:09.208572+0000","last_peered":"2024-04-14T10:58:09.208572+0000","last_clean":"2024-04-14T10:58:09.208572+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:09.208572+0000","last_undegraded":"2024-04-14T10:58:09.208572+0000","last_fullsized":"2024-04-14T10:58:09.208572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.231252+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:14.231252+0000","last_peered":"2024-04-14T10:58:14.231252+0000","last_clean":"2024-04-14T10:58:14.231252+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:14.231252+0000","last_undegraded":"2024-04-14T10:58:14.231252+0000","last_fullsized":"2024-04-14T10:58:14.231252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254160+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:20.254160+0000","last_peered":"2024-04-14T10:58:20.254160+0000","last_clean":"2024-04-14T10:58:20.254160+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:20.254160+0000","last_undegraded":"2024-04-14T10:58:20.254160+0000","last_fullsized":"2024-04-14T10:58:20.254160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232204+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:14.232204+0000","last_peered":"2024-04-14T10:58:14.232204+0000","last_clean":"2024-04-14T10:58:14.232204+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:14.232204+0000","last_undegraded":"2024-04-14T10:58:14.232204+0000","last_fullsized":"2024-04-14T10:58:14.232204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253494+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:20.253494+0000","last_peered":"2024-04-14T10:58:20.253494+0000","last_clean":"2024-04-14T10:58:20.253494+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:20.253494+0000","last_undegraded":"2024-04-14T10:58:20.253494+0000","last_fullsized":"2024-04-14T10:58:20.253494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'15","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.260505+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:20.260505+0000","last_peered":"2024-04-14T10:58:20.260505+0000","last_clean":"2024-04-14T10:58:20.260505+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:20.260505+0000","last_undegraded":"2024-04-14T10:58:20.260505+0000","last_fullsized":"2024-04-14T10:58:20.260505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.204252+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:09.204252+0000","last_peered":"2024-04-14T10:58:09.204252+0000","last_clean":"2024-04-14T10:58:09.204252+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:09.204252+0000","last_undegraded":"2024-04-14T10:58:09.204252+0000","last_fullsized":"2024-04-14T10:58:09.204252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203250+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:09.203250+0000","last_peered":"2024-04-14T10:58:09.203250+0000","last_clean":"2024-04-14T10:58:09.203250+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:09.203250+0000","last_undegraded":"2024-04-14T10:58:09.203250+0000","last_fullsized":"2024-04-14T10:58:09.203250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422915+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:06.422915+0000","last_peered":"2024-04-14T10:58:06.422915+0000","last_clean":"2024-04-14T10:58:06.422915+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:06.422915+0000","last_undegraded":"2024-04-14T10:58:06.422915+0000","last_fullsized":"2024-04-14T10:58:06.422915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.256163+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:20.256163+0000","last_peered":"2024-04-14T10:58:20.256163+0000","last_clean":"2024-04-14T10:58:20.256163+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:20.256163+0000","last_undegraded":"2024-04-14T10:58:20.256163+0000","last_fullsized":"2024-04-14T10:58:20.256163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233698+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:14.233698+0000","last_peered":"2024-04-14T10:58:14.233698+0000","last_clean":"2024-04-14T10:58:14.233698+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:14.233698+0000","last_undegraded":"2024-04-14T10:58:14.233698+0000","last_fullsized":"2024-04-14T10:58:14.233698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.257601+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:20.257601+0000","last_peered":"2024-04-14T10:58:20.257601+0000","last_clean":"2024-04-14T10:58:20.257601+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:20.257601+0000","last_undegraded":"2024-04-14T10:58:20.257601+0000","last_fullsized":"2024-04-14T10:58:20.257601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.255438+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:20.255438+0000","last_peered":"2024-04-14T10:58:20.255438+0000","last_clean":"2024-04-14T10:58:20.255438+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:20.255438+0000","last_undegraded":"2024-04-14T10:58:20.255438+0000","last_fullsized":"2024-04-14T10:58:20.255438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417473+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:06.417473+0000","last_peered":"2024-04-14T10:58:06.417473+0000","last_clean":"2024-04-14T10:58:06.417473+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:06.417473+0000","last_undegraded":"2024-04-14T10:58:06.417473+0000","last_fullsized":"2024-04-14T10:58:06.417473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417091+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:06.417091+0000","last_peered":"2024-04-14T10:58:06.417091+0000","last_clean":"2024-04-14T10:58:06.417091+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:06.417091+0000","last_undegraded":"2024-04-14T10:58:06.417091+0000","last_fullsized":"2024-04-14T10:58:06.417091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254084+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:20.254084+0000","last_peered":"2024-04-14T10:58:20.254084+0000","last_clean":"2024-04-14T10:58:20.254084+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:20.254084+0000","last_undegraded":"2024-04-14T10:58:20.254084+0000","last_fullsized":"2024-04-14T10:58:20.254084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232877+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:14.232877+0000","last_peered":"2024-04-14T10:58:14.232877+0000","last_clean":"2024-04-14T10:58:14.232877+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:14.232877+0000","last_undegraded":"2024-04-14T10:58:14.232877+0000","last_fullsized":"2024-04-14T10:58:14.232877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232381+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:14.232381+0000","last_peered":"2024-04-14T10:58:14.232381+0000","last_clean":"2024-04-14T10:58:14.232381+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:14.232381+0000","last_undegraded":"2024-04-14T10:58:14.232381+0000","last_fullsized":"2024-04-14T10:58:14.232381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232759+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:14.232759+0000","last_peered":"2024-04-14T10:58:14.232759+0000","last_clean":"2024-04-14T10:58:14.232759+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:14.232759+0000","last_undegraded":"2024-04-14T10:58:14.232759+0000","last_fullsized":"2024-04-14T10:58:14.232759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422844+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:06.422844+0000","last_peered":"2024-04-14T10:58:06.422844+0000","last_clean":"2024-04-14T10:58:06.422844+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:06.422844+0000","last_undegraded":"2024-04-14T10:58:06.422844+0000","last_fullsized":"2024-04-14T10:58:06.422844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233983+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:14.233983+0000","last_peered":"2024-04-14T10:58:14.233983+0000","last_clean":"2024-04-14T10:58:14.233983+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:14.233983+0000","last_undegraded":"2024-04-14T10:58:14.233983+0000","last_fullsized":"2024-04-14T10:58:14.233983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208343+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:09.208343+0000","last_peered":"2024-04-14T10:58:09.208343+0000","last_clean":"2024-04-14T10:58:09.208343+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:09.208343+0000","last_undegraded":"2024-04-14T10:58:09.208343+0000","last_fullsized":"2024-04-14T10:58:09.208343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253115+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:20.253115+0000","last_peered":"2024-04-14T10:58:20.253115+0000","last_clean":"2024-04-14T10:58:20.253115+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:20.253115+0000","last_undegraded":"2024-04-14T10:58:20.253115+0000","last_fullsized":"2024-04-14T10:58:20.253115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203010+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:09.203010+0000","last_peered":"2024-04-14T10:58:09.203010+0000","last_clean":"2024-04-14T10:58:09.203010+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:09.203010+0000","last_undegraded":"2024-04-14T10:58:09.203010+0000","last_fullsized":"2024-04-14T10:58:09.203010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254806+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:20.254806+0000","last_peered":"2024-04-14T10:58:20.254806+0000","last_clean":"2024-04-14T10:58:20.254806+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:20.254806+0000","last_undegraded":"2024-04-14T10:58:20.254806+0000","last_fullsized":"2024-04-14T10:58:20.254806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":819200,"data_stored":662618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":73224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":72312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":71648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":73258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":661962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:31.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.922+0000 7fca30fcc640 1 Processor -- start 2024-04-14T10:58:31.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.922+0000 7fca30fcc640 1 -- start start 2024-04-14T10:58:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca30fcc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca30fcc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca2c0b3930 0x7fca2c0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca30fcc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2c0ccd90 con 0x7fca2c15afc0 2024-04-14T10:58:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca30fcc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fca2c15e4d0 con 0x7fca2c0b3930 2024-04-14T10:58:31.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca30fcc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fca2c15e7b0 con 0x7fca2c155160 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca2c0b3930 0x7fca2c0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fca2c0b3930 0x7fca2c0cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41890/0 (socket says 172.21.15.84:41890) 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 -- 172.21.15.84:0/501389969 learned_addr learned my addr 172.21.15.84:0/501389969 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca2a59c640 1 --2- 172.21.15.84:0/501389969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 -- 172.21.15.84:0/501389969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 msgr2=0x7fca2c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 --2- 172.21.15.84:0/501389969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 -- 172.21.15.84:0/501389969 >> v1:172.21.15.175:6789/0 conn(0x7fca2c15afc0 legacy=0x7fca2c0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.923+0000 7fca23fff640 1 -- 172.21.15.84:0/501389969 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c15ea90 con 0x7fca2c0b3930 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca23fff640 1 --2- 172.21.15.84:0/501389969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c0cb910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca14009870 tx=0x7fca1402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c871ad3c22e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca29d9b640 1 -- 172.21.15.84:0/501389969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1402f840 con 0x7fca2c0b3930 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca29d9b640 1 -- 172.21.15.84:0/501389969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1402f9e0 con 0x7fca2c0b3930 2024-04-14T10:58:31.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca29d9b640 1 -- 172.21.15.84:0/501389969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1402fdb0 con 0x7fca2c0b3930 2024-04-14T10:58:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca30fcc640 1 -- 172.21.15.84:0/501389969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 msgr2=0x7fca2c0cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca30fcc640 1 --2- 172.21.15.84:0/501389969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c0cb910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca14009870 tx=0x7fca1402ba20 comp rx=0 tx=0).stop 2024-04-14T10:58:31.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca30fcc640 1 -- 172.21.15.84:0/501389969 shutdown_connections 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca30fcc640 1 --2- 172.21.15.84:0/501389969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c0cb910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.924+0000 7fca30fcc640 1 --2- 172.21.15.84:0/501389969 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.925+0000 7fca30fcc640 1 -- 172.21.15.84:0/501389969 >> 172.21.15.84:0/501389969 conn(0x7fca2c06b900 msgr2=0x7fca2c06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.925+0000 7fca30fcc640 1 -- 172.21.15.84:0/501389969 shutdown_connections 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.925+0000 7fca30fcc640 1 -- 172.21.15.84:0/501389969 wait complete. 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 Processor -- start 2024-04-14T10:58:31.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 -- start start 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2c15afc0 0x7fca2c0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c155540 con 0x7fca2c0b3930 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c15f050 con 0x7fca2c15afc0 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.926+0000 7fca30fcc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fca2c0cc860 con 0x7fca2c155160 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c1f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41900/0 (socket says 172.21.15.84:41900) 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 -- 172.21.15.84:0/630449902 learned_addr learned my addr 172.21.15.84:0/630449902 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:31.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca23fff640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2ad9d640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2c15afc0 0x7fca2c0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 -- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 msgr2=0x7fca2c157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 -- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2c15afc0 msgr2=0x7fca2c0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2c15afc0 0x7fca2c0d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 -- 172.21.15.84:0/630449902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c0c99c0 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca23fff640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca2a59c640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c1f1550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00e9e0 tx=0x7fca1c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c017070 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c00c9d0 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c156680 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c00cdc0 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.927+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c156f90 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.928+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2c069c30 con 0x7fca2c0b3930 2024-04-14T10:58:31.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.929+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca1c01a070 con 0x7fca2c0b3930 2024-04-14T10:58:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.929+0000 7fca22ffd640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fca0c06c8f0 0x7fca0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.929+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca1c08bc80 con 0x7fca2c0b3930 2024-04-14T10:58:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.929+0000 7fca23fff640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fca0c06c8f0 0x7fca0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:31.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.930+0000 7fca23fff640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fca0c06c8f0 0x7fca0c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca14036000 tx=0x7fca14039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:31.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:31.934+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fca2c0c99c0 con 0x7fca2c0b3930 2024-04-14T10:58:32.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.107+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca2c0cbf30 con 0x7fca0c06c8f0 2024-04-14T10:58:32.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.113+0000 7fca22ffd640 1 -- 172.21.15.84:0/630449902 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7fca2c0cbf30 con 0x7fca0c06c8f0 2024-04-14T10:58:32.114 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:32.115 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fca0c06c8f0 msgr2=0x7fca0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fca0c06c8f0 0x7fca0c06edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca14036000 tx=0x7fca14039040 comp rx=0 tx=0).stop 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 msgr2=0x7fca2c1f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c1f1550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00e9e0 tx=0x7fca1c00eea0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 shutdown_connections 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fca0c06c8f0 0x7fca0c06edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca2c15afc0 0x7fca2c0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca2c155160 0x7fca2c157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 --2- 172.21.15.84:0/630449902 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fca2c0b3930 0x7fca2c1f1550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 >> 172.21.15.84:0/630449902 conn(0x7fca2c06b900 msgr2=0x7fca2c06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 shutdown_connections 2024-04-14T10:58:32.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.116+0000 7fca30fcc640 1 -- 172.21.15.84:0/630449902 wait complete. 2024-04-14T10:58:32.125 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-14T10:58:31.407341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2990080,"data_stored":1758652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'5","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.234221+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:14.234221+0000","last_peered":"2024-04-14T10:58:14.234221+0000","last_clean":"2024-04-14T10:58:14.234221+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:14.234221+0000","last_undegraded":"2024-04-14T10:58:14.234221+0000","last_fullsized":"2024-04-14T10:58:14.234221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253216+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:20.253216+0000","last_peered":"2024-04-14T10:58:20.253216+0000","last_clean":"2024-04-14T10:58:20.253216+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:20.253216+0000","last_undegraded":"2024-04-14T10:58:20.253216+0000","last_fullsized":"2024-04-14T10:58:20.253216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253195+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:20.253195+0000","last_peered":"2024-04-14T10:58:20.253195+0000","last_clean":"2024-04-14T10:58:20.253195+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:20.253195+0000","last_undegraded":"2024-04-14T10:58:20.253195+0000","last_fullsized":"2024-04-14T10:58:20.253195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417427+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:06.417427+0000","last_peered":"2024-04-14T10:58:06.417427+0000","last_clean":"2024-04-14T10:58:06.417427+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:06.417427+0000","last_undegraded":"2024-04-14T10:58:06.417427+0000","last_fullsized":"2024-04-14T10:58:06.417427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.234202+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:14.234202+0000","last_peered":"2024-04-14T10:58:14.234202+0000","last_clean":"2024-04-14T10:58:14.234202+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:14.234202+0000","last_undegraded":"2024-04-14T10:58:14.234202+0000","last_fullsized":"2024-04-14T10:58:14.234202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233942+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:14.233942+0000","last_peered":"2024-04-14T10:58:14.233942+0000","last_clean":"2024-04-14T10:58:14.233942+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:14.233942+0000","last_undegraded":"2024-04-14T10:58:14.233942+0000","last_fullsized":"2024-04-14T10:58:14.233942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208572+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:09.208572+0000","last_peered":"2024-04-14T10:58:09.208572+0000","last_clean":"2024-04-14T10:58:09.208572+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:09.208572+0000","last_undegraded":"2024-04-14T10:58:09.208572+0000","last_fullsized":"2024-04-14T10:58:09.208572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.231252+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:14.231252+0000","last_peered":"2024-04-14T10:58:14.231252+0000","last_clean":"2024-04-14T10:58:14.231252+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:14.231252+0000","last_undegraded":"2024-04-14T10:58:14.231252+0000","last_fullsized":"2024-04-14T10:58:14.231252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254160+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:20.254160+0000","last_peered":"2024-04-14T10:58:20.254160+0000","last_clean":"2024-04-14T10:58:20.254160+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:20.254160+0000","last_undegraded":"2024-04-14T10:58:20.254160+0000","last_fullsized":"2024-04-14T10:58:20.254160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232204+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:14.232204+0000","last_peered":"2024-04-14T10:58:14.232204+0000","last_clean":"2024-04-14T10:58:14.232204+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:14.232204+0000","last_undegraded":"2024-04-14T10:58:14.232204+0000","last_fullsized":"2024-04-14T10:58:14.232204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253494+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:20.253494+0000","last_peered":"2024-04-14T10:58:20.253494+0000","last_clean":"2024-04-14T10:58:20.253494+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:20.253494+0000","last_undegraded":"2024-04-14T10:58:20.253494+0000","last_fullsized":"2024-04-14T10:58:20.253494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'15","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.260505+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:20.260505+0000","last_peered":"2024-04-14T10:58:20.260505+0000","last_clean":"2024-04-14T10:58:20.260505+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:20.260505+0000","last_undegraded":"2024-04-14T10:58:20.260505+0000","last_fullsized":"2024-04-14T10:58:20.260505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.204252+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:09.204252+0000","last_peered":"2024-04-14T10:58:09.204252+0000","last_clean":"2024-04-14T10:58:09.204252+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:09.204252+0000","last_undegraded":"2024-04-14T10:58:09.204252+0000","last_fullsized":"2024-04-14T10:58:09.204252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203250+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:09.203250+0000","last_peered":"2024-04-14T10:58:09.203250+0000","last_clean":"2024-04-14T10:58:09.203250+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:09.203250+0000","last_undegraded":"2024-04-14T10:58:09.203250+0000","last_fullsized":"2024-04-14T10:58:09.203250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422915+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:06.422915+0000","last_peered":"2024-04-14T10:58:06.422915+0000","last_clean":"2024-04-14T10:58:06.422915+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:06.422915+0000","last_undegraded":"2024-04-14T10:58:06.422915+0000","last_fullsized":"2024-04-14T10:58:06.422915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.256163+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:20.256163+0000","last_peered":"2024-04-14T10:58:20.256163+0000","last_clean":"2024-04-14T10:58:20.256163+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:20.256163+0000","last_undegraded":"2024-04-14T10:58:20.256163+0000","last_fullsized":"2024-04-14T10:58:20.256163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233698+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:14.233698+0000","last_peered":"2024-04-14T10:58:14.233698+0000","last_clean":"2024-04-14T10:58:14.233698+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:14.233698+0000","last_undegraded":"2024-04-14T10:58:14.233698+0000","last_fullsized":"2024-04-14T10:58:14.233698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.257601+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:20.257601+0000","last_peered":"2024-04-14T10:58:20.257601+0000","last_clean":"2024-04-14T10:58:20.257601+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:20.257601+0000","last_undegraded":"2024-04-14T10:58:20.257601+0000","last_fullsized":"2024-04-14T10:58:20.257601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.255438+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:20.255438+0000","last_peered":"2024-04-14T10:58:20.255438+0000","last_clean":"2024-04-14T10:58:20.255438+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:20.255438+0000","last_undegraded":"2024-04-14T10:58:20.255438+0000","last_fullsized":"2024-04-14T10:58:20.255438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417473+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:06.417473+0000","last_peered":"2024-04-14T10:58:06.417473+0000","last_clean":"2024-04-14T10:58:06.417473+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:06.417473+0000","last_undegraded":"2024-04-14T10:58:06.417473+0000","last_fullsized":"2024-04-14T10:58:06.417473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417091+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:06.417091+0000","last_peered":"2024-04-14T10:58:06.417091+0000","last_clean":"2024-04-14T10:58:06.417091+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:06.417091+0000","last_undegraded":"2024-04-14T10:58:06.417091+0000","last_fullsized":"2024-04-14T10:58:06.417091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254084+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:20.254084+0000","last_peered":"2024-04-14T10:58:20.254084+0000","last_clean":"2024-04-14T10:58:20.254084+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:20.254084+0000","last_undegraded":"2024-04-14T10:58:20.254084+0000","last_fullsized":"2024-04-14T10:58:20.254084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232877+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:14.232877+0000","last_peered":"2024-04-14T10:58:14.232877+0000","last_clean":"2024-04-14T10:58:14.232877+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:14.232877+0000","last_undegraded":"2024-04-14T10:58:14.232877+0000","last_fullsized":"2024-04-14T10:58:14.232877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232381+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:14.232381+0000","last_peered":"2024-04-14T10:58:14.232381+0000","last_clean":"2024-04-14T10:58:14.232381+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:14.232381+0000","last_undegraded":"2024-04-14T10:58:14.232381+0000","last_fullsized":"2024-04-14T10:58:14.232381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232759+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:14.232759+0000","last_peered":"2024-04-14T10:58:14.232759+0000","last_clean":"2024-04-14T10:58:14.232759+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:14.232759+0000","last_undegraded":"2024-04-14T10:58:14.232759+0000","last_fullsized":"2024-04-14T10:58:14.232759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422844+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:06.422844+0000","last_peered":"2024-04-14T10:58:06.422844+0000","last_clean":"2024-04-14T10:58:06.422844+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:06.422844+0000","last_undegraded":"2024-04-14T10:58:06.422844+0000","last_fullsized":"2024-04-14T10:58:06.422844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233983+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:14.233983+0000","last_peered":"2024-04-14T10:58:14.233983+0000","last_clean":"2024-04-14T10:58:14.233983+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:14.233983+0000","last_undegraded":"2024-04-14T10:58:14.233983+0000","last_fullsized":"2024-04-14T10:58:14.233983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208343+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:09.208343+0000","last_peered":"2024-04-14T10:58:09.208343+0000","last_clean":"2024-04-14T10:58:09.208343+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:09.208343+0000","last_undegraded":"2024-04-14T10:58:09.208343+0000","last_fullsized":"2024-04-14T10:58:09.208343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253115+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:20.253115+0000","last_peered":"2024-04-14T10:58:20.253115+0000","last_clean":"2024-04-14T10:58:20.253115+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:20.253115+0000","last_undegraded":"2024-04-14T10:58:20.253115+0000","last_fullsized":"2024-04-14T10:58:20.253115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203010+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:09.203010+0000","last_peered":"2024-04-14T10:58:09.203010+0000","last_clean":"2024-04-14T10:58:09.203010+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:09.203010+0000","last_undegraded":"2024-04-14T10:58:09.203010+0000","last_fullsized":"2024-04-14T10:58:09.203010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254806+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:20.254806+0000","last_peered":"2024-04-14T10:58:20.254806+0000","last_clean":"2024-04-14T10:58:20.254806+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:20.254806+0000","last_undegraded":"2024-04-14T10:58:20.254806+0000","last_fullsized":"2024-04-14T10:58:20.254806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":819200,"data_stored":662618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":73224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":72312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":71648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":73258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":661962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:32.129 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-14T10:58:32.129 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:58:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 Processor -- start 2024-04-14T10:58:32.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 -- start start 2024-04-14T10:58:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9541551d0 0x7fc95406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9540ce320 0x7fc9540ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc95415c6e0 0x7fc95415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc95415d0b0 con 0x7fc9540ce320 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc95415acd0 con 0x7fc9541551d0 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.268+0000 7fc95b420640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc95415af70 con 0x7fc95415c6e0 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9540ce320 0x7fc9540ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc9540ce320 0x7fc9540ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41902/0 (socket says 172.21.15.84:41902) 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 -- 172.21.15.84:0/107843213 learned_addr learned my addr 172.21.15.84:0/107843213 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9591bc640 1 --2- 172.21.15.84:0/107843213 >> v2:172.21.15.175:3300/0 conn(0x7fc9541551d0 0x7fc95406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9599bd640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc95415c6e0 0x7fc95415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 -- 172.21.15.84:0/107843213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc95415c6e0 msgr2=0x7fc95415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc95415c6e0 0x7fc95415cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 -- 172.21.15.84:0/107843213 >> v2:172.21.15.175:3300/0 conn(0x7fc9541551d0 msgr2=0x7fc95406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 --2- 172.21.15.84:0/107843213 >> v2:172.21.15.175:3300/0 conn(0x7fc9541551d0 0x7fc95406faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9589bb640 1 -- 172.21.15.84:0/107843213 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95415b210 con 0x7fc9540ce320 2024-04-14T10:58:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9591bc640 1 --2- 172.21.15.84:0/107843213 >> v2:172.21.15.175:3300/0 conn(0x7fc9541551d0 0x7fc95406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:32.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.269+0000 7fc9599bd640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc95415c6e0 0x7fc95415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc9589bb640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9540ce750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc954072df0 tx=0x7fc94402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b27dcbf9fa2924 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc94bfff640 1 -- 172.21.15.84:0/107843213 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944034070 con 0x7fc9540ce320 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc94bfff640 1 -- 172.21.15.84:0/107843213 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944030860 con 0x7fc9540ce320 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc94bfff640 1 -- 172.21.15.84:0/107843213 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944030c30 con 0x7fc9540ce320 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 -- 172.21.15.84:0/107843213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 msgr2=0x7fc9540ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9540ce750 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc954072df0 tx=0x7fc94402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 -- 172.21.15.84:0/107843213 shutdown_connections 2024-04-14T10:58:32.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc95415c6e0 0x7fc95415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 --2- 172.21.15.84:0/107843213 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9540ce750 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 --2- 172.21.15.84:0/107843213 >> v2:172.21.15.175:3300/0 conn(0x7fc9541551d0 0x7fc95406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 -- 172.21.15.84:0/107843213 >> 172.21.15.84:0/107843213 conn(0x7fc95406db10 msgr2=0x7fc95406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 -- 172.21.15.84:0/107843213 shutdown_connections 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.270+0000 7fc95b420640 1 -- 172.21.15.84:0/107843213 wait complete. 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.271+0000 7fc95b420640 1 Processor -- start 2024-04-14T10:58:32.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 -- start start 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9541e40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9541551d0 0x7fc9541e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc95415c6e0 0x7fc9540c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc95415bab0 con 0x7fc9540ce320 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc95415b7d0 con 0x7fc95415c6e0 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc95b420640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc95415c1c0 con 0x7fc9541551d0 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc9591bc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9541e40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc9591bc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9541e40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41918/0 (socket says 172.21.15.84:41918) 2024-04-14T10:58:32.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.272+0000 7fc9591bc640 1 -- 172.21.15.84:0/368896177 learned_addr learned my addr 172.21.15.84:0/368896177 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc9591bc640 1 -- 172.21.15.84:0/368896177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9541551d0 msgr2=0x7fc9541e6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc9591bc640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9541551d0 0x7fc9541e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc9591bc640 1 -- 172.21.15.84:0/368896177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc95415c6e0 msgr2=0x7fc9540c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc9591bc640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc95415c6e0 0x7fc9540c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc9591bc640 1 -- 172.21.15.84:0/368896177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9540c5710 con 0x7fc9540ce320 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc9591bc640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9541e40e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00cf10 tx=0x7fc94c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c01a070 con 0x7fc9540ce320 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc94c00d840 con 0x7fc9540ce320 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9541523b0 con 0x7fc9540ce320 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94c00dc10 con 0x7fc9540ce320 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.273+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9540c67c0 con 0x7fc9540ce320 2024-04-14T10:58:32.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.274+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9540c5480 con 0x7fc9540ce320 2024-04-14T10:58:32.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.274+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc94c01d070 con 0x7fc9540ce320 2024-04-14T10:58:32.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.275+0000 7fc949ffb640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc93806c8f0 0x7fc93806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.275+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc94c08c380 con 0x7fc9540ce320 2024-04-14T10:58:32.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.275+0000 7fc9589bb640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc93806c8f0 0x7fc93806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.275+0000 7fc9589bb640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc93806c8f0 0x7fc93806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc944036000 tx=0x7fc944030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.279+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc94c05a190 con 0x7fc9540ce320 2024-04-14T10:58:32.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.453+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc954069c30 con 0x7fc93806c8f0 2024-04-14T10:58:32.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.458+0000 7fc949ffb640 1 -- 172.21.15.84:0/368896177 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7fc954069c30 con 0x7fc93806c8f0 2024-04-14T10:58:32.459 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:32.461 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T10:58:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc93806c8f0 msgr2=0x7fc93806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc93806c8f0 0x7fc93806edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc944036000 tx=0x7fc944030000 comp rx=0 tx=0).stop 2024-04-14T10:58:32.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 msgr2=0x7fc9541e40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9541e40e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc94c00cf10 tx=0x7fc94c00a710 comp rx=0 tx=0).stop 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 shutdown_connections 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc93806c8f0 0x7fc93806edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc95415c6e0 0x7fc9540c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9541551d0 0x7fc9541e6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 --2- 172.21.15.84:0/368896177 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc9540ce320 0x7fc9541e40e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 >> 172.21.15.84:0/368896177 conn(0x7fc95406db10 msgr2=0x7fc9541593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 shutdown_connections 2024-04-14T10:58:32.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.462+0000 7fc95b420640 1 -- 172.21.15.84:0/368896177 wait complete. 2024-04-14T10:58:32.471 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-14T10:58:31.407341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":284,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2990080,"data_stored":1758652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572274+0000","last_change":"2024-04-14T10:58:04.209124+0000","last_active":"2024-04-14T10:58:05.572274+0000","last_peered":"2024-04-14T10:58:05.572274+0000","last_clean":"2024-04-14T10:58:05.572274+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T10:58:05.572274+0000","last_undegraded":"2024-04-14T10:58:05.572274+0000","last_fullsized":"2024-04-14T10:58:05.572274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197665+0000","last_change":"2024-04-14T10:58:04.202274+0000","last_active":"2024-04-14T10:58:05.197665+0000","last_peered":"2024-04-14T10:58:05.197665+0000","last_clean":"2024-04-14T10:58:05.197665+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T10:58:05.197665+0000","last_undegraded":"2024-04-14T10:58:05.197665+0000","last_fullsized":"2024-04-14T10:58:05.197665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336726+0000","last_change":"2024-04-14T10:58:04.201013+0000","last_active":"2024-04-14T10:58:05.336726+0000","last_peered":"2024-04-14T10:58:05.336726+0000","last_clean":"2024-04-14T10:58:05.336726+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T10:58:05.336726+0000","last_undegraded":"2024-04-14T10:58:05.336726+0000","last_fullsized":"2024-04-14T10:58:05.336726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203318+0000","last_change":"2024-04-14T10:58:04.206222+0000","last_active":"2024-04-14T10:58:05.203318+0000","last_peered":"2024-04-14T10:58:05.203318+0000","last_clean":"2024-04-14T10:58:05.203318+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T10:58:05.203318+0000","last_undegraded":"2024-04-14T10:58:05.203318+0000","last_fullsized":"2024-04-14T10:58:05.203318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571863+0000","last_change":"2024-04-14T10:58:04.208610+0000","last_active":"2024-04-14T10:58:05.571863+0000","last_peered":"2024-04-14T10:58:05.571863+0000","last_clean":"2024-04-14T10:58:05.571863+0000","last_became_active":"2024-04-14T10:58:04.208330+0000","last_became_peered":"2024-04-14T10:58:04.208330+0000","last_unstale":"2024-04-14T10:58:05.571863+0000","last_undegraded":"2024-04-14T10:58:05.571863+0000","last_fullsized":"2024-04-14T10:58:05.571863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203061+0000","last_change":"2024-04-14T10:58:04.201712+0000","last_active":"2024-04-14T10:58:05.203061+0000","last_peered":"2024-04-14T10:58:05.203061+0000","last_clean":"2024-04-14T10:58:05.203061+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T10:58:05.203061+0000","last_undegraded":"2024-04-14T10:58:05.203061+0000","last_fullsized":"2024-04-14T10:58:05.203061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571645+0000","last_change":"2024-04-14T10:58:04.209812+0000","last_active":"2024-04-14T10:58:05.571645+0000","last_peered":"2024-04-14T10:58:05.571645+0000","last_clean":"2024-04-14T10:58:05.571645+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T10:58:05.571645+0000","last_undegraded":"2024-04-14T10:58:05.571645+0000","last_fullsized":"2024-04-14T10:58:05.571645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570915+0000","last_change":"2024-04-14T10:58:04.205605+0000","last_active":"2024-04-14T10:58:05.570915+0000","last_peered":"2024-04-14T10:58:05.570915+0000","last_clean":"2024-04-14T10:58:05.570915+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T10:58:05.570915+0000","last_undegraded":"2024-04-14T10:58:05.570915+0000","last_fullsized":"2024-04-14T10:58:05.570915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572273+0000","last_change":"2024-04-14T10:58:04.213105+0000","last_active":"2024-04-14T10:58:05.572273+0000","last_peered":"2024-04-14T10:58:05.572273+0000","last_clean":"2024-04-14T10:58:05.572273+0000","last_became_active":"2024-04-14T10:58:04.212828+0000","last_became_peered":"2024-04-14T10:58:04.212828+0000","last_unstale":"2024-04-14T10:58:05.572273+0000","last_undegraded":"2024-04-14T10:58:05.572273+0000","last_fullsized":"2024-04-14T10:58:05.572273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571893+0000","last_change":"2024-04-14T10:58:04.209310+0000","last_active":"2024-04-14T10:58:05.571893+0000","last_peered":"2024-04-14T10:58:05.571893+0000","last_clean":"2024-04-14T10:58:05.571893+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T10:58:05.571893+0000","last_undegraded":"2024-04-14T10:58:05.571893+0000","last_fullsized":"2024-04-14T10:58:05.571893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572409+0000","last_change":"2024-04-14T10:58:04.209692+0000","last_active":"2024-04-14T10:58:05.572409+0000","last_peered":"2024-04-14T10:58:05.572409+0000","last_clean":"2024-04-14T10:58:05.572409+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T10:58:05.572409+0000","last_undegraded":"2024-04-14T10:58:05.572409+0000","last_fullsized":"2024-04-14T10:58:05.572409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204394+0000","last_change":"2024-04-14T10:58:04.205846+0000","last_active":"2024-04-14T10:58:05.204394+0000","last_peered":"2024-04-14T10:58:05.204394+0000","last_clean":"2024-04-14T10:58:05.204394+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T10:58:05.204394+0000","last_undegraded":"2024-04-14T10:58:05.204394+0000","last_fullsized":"2024-04-14T10:58:05.204394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571133+0000","last_change":"2024-04-14T10:58:04.205795+0000","last_active":"2024-04-14T10:58:05.571133+0000","last_peered":"2024-04-14T10:58:05.571133+0000","last_clean":"2024-04-14T10:58:05.571133+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T10:58:05.571133+0000","last_undegraded":"2024-04-14T10:58:05.571133+0000","last_fullsized":"2024-04-14T10:58:05.571133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336865+0000","last_change":"2024-04-14T10:58:04.206105+0000","last_active":"2024-04-14T10:58:05.336865+0000","last_peered":"2024-04-14T10:58:05.336865+0000","last_clean":"2024-04-14T10:58:05.336865+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T10:58:05.336865+0000","last_undegraded":"2024-04-14T10:58:05.336865+0000","last_fullsized":"2024-04-14T10:58:05.336865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197458+0000","last_change":"2024-04-14T10:58:04.198351+0000","last_active":"2024-04-14T10:58:05.197458+0000","last_peered":"2024-04-14T10:58:05.197458+0000","last_clean":"2024-04-14T10:58:05.197458+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T10:58:05.197458+0000","last_undegraded":"2024-04-14T10:58:05.197458+0000","last_fullsized":"2024-04-14T10:58:05.197458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202633+0000","last_change":"2024-04-14T10:58:04.203645+0000","last_active":"2024-04-14T10:58:05.202633+0000","last_peered":"2024-04-14T10:58:05.202633+0000","last_clean":"2024-04-14T10:58:05.202633+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T10:58:05.202633+0000","last_undegraded":"2024-04-14T10:58:05.202633+0000","last_fullsized":"2024-04-14T10:58:05.202633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203346+0000","last_change":"2024-04-14T10:58:04.212557+0000","last_active":"2024-04-14T10:58:05.203346+0000","last_peered":"2024-04-14T10:58:05.203346+0000","last_clean":"2024-04-14T10:58:05.203346+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T10:58:05.203346+0000","last_undegraded":"2024-04-14T10:58:05.203346+0000","last_fullsized":"2024-04-14T10:58:05.203346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571437+0000","last_change":"2024-04-14T10:58:04.203957+0000","last_active":"2024-04-14T10:58:05.571437+0000","last_peered":"2024-04-14T10:58:05.571437+0000","last_clean":"2024-04-14T10:58:05.571437+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T10:58:05.571437+0000","last_undegraded":"2024-04-14T10:58:05.571437+0000","last_fullsized":"2024-04-14T10:58:05.571437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572363+0000","last_change":"2024-04-14T10:58:04.212740+0000","last_active":"2024-04-14T10:58:05.572363+0000","last_peered":"2024-04-14T10:58:05.572363+0000","last_clean":"2024-04-14T10:58:05.572363+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T10:58:05.572363+0000","last_undegraded":"2024-04-14T10:58:05.572363+0000","last_fullsized":"2024-04-14T10:58:05.572363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571546+0000","last_change":"2024-04-14T10:58:04.205872+0000","last_active":"2024-04-14T10:58:05.571546+0000","last_peered":"2024-04-14T10:58:05.571546+0000","last_clean":"2024-04-14T10:58:05.571546+0000","last_became_active":"2024-04-14T10:58:04.205651+0000","last_became_peered":"2024-04-14T10:58:04.205651+0000","last_unstale":"2024-04-14T10:58:05.571546+0000","last_undegraded":"2024-04-14T10:58:05.571546+0000","last_fullsized":"2024-04-14T10:58:05.571546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336860+0000","last_change":"2024-04-14T10:58:04.209277+0000","last_active":"2024-04-14T10:58:05.336860+0000","last_peered":"2024-04-14T10:58:05.336860+0000","last_clean":"2024-04-14T10:58:05.336860+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T10:58:05.336860+0000","last_undegraded":"2024-04-14T10:58:05.336860+0000","last_fullsized":"2024-04-14T10:58:05.336860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203159+0000","last_change":"2024-04-14T10:58:04.208434+0000","last_active":"2024-04-14T10:58:05.203159+0000","last_peered":"2024-04-14T10:58:05.203159+0000","last_clean":"2024-04-14T10:58:05.203159+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T10:58:05.203159+0000","last_undegraded":"2024-04-14T10:58:05.203159+0000","last_fullsized":"2024-04-14T10:58:05.203159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571052+0000","last_change":"2024-04-14T10:58:04.211391+0000","last_active":"2024-04-14T10:58:05.571052+0000","last_peered":"2024-04-14T10:58:05.571052+0000","last_clean":"2024-04-14T10:58:05.571052+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T10:58:05.571052+0000","last_undegraded":"2024-04-14T10:58:05.571052+0000","last_fullsized":"2024-04-14T10:58:05.571052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202796+0000","last_change":"2024-04-14T10:58:04.200538+0000","last_active":"2024-04-14T10:58:05.202796+0000","last_peered":"2024-04-14T10:58:05.202796+0000","last_clean":"2024-04-14T10:58:05.202796+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T10:58:05.202796+0000","last_undegraded":"2024-04-14T10:58:05.202796+0000","last_fullsized":"2024-04-14T10:58:05.202796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571317+0000","last_change":"2024-04-14T10:58:04.211365+0000","last_active":"2024-04-14T10:58:05.571317+0000","last_peered":"2024-04-14T10:58:05.571317+0000","last_clean":"2024-04-14T10:58:05.571317+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T10:58:05.571317+0000","last_undegraded":"2024-04-14T10:58:05.571317+0000","last_fullsized":"2024-04-14T10:58:05.571317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571962+0000","last_change":"2024-04-14T10:58:04.209576+0000","last_active":"2024-04-14T10:58:05.571962+0000","last_peered":"2024-04-14T10:58:05.571962+0000","last_clean":"2024-04-14T10:58:05.571962+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T10:58:05.571962+0000","last_undegraded":"2024-04-14T10:58:05.571962+0000","last_fullsized":"2024-04-14T10:58:05.571962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197637+0000","last_change":"2024-04-14T10:58:04.201910+0000","last_active":"2024-04-14T10:58:05.197637+0000","last_peered":"2024-04-14T10:58:05.197637+0000","last_clean":"2024-04-14T10:58:05.197637+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T10:58:05.197637+0000","last_undegraded":"2024-04-14T10:58:05.197637+0000","last_fullsized":"2024-04-14T10:58:05.197637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571350+0000","last_change":"2024-04-14T10:58:04.212120+0000","last_active":"2024-04-14T10:58:05.571350+0000","last_peered":"2024-04-14T10:58:05.571350+0000","last_clean":"2024-04-14T10:58:05.571350+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T10:58:05.571350+0000","last_undegraded":"2024-04-14T10:58:05.571350+0000","last_fullsized":"2024-04-14T10:58:05.571350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:59:37.723982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336910+0000","last_change":"2024-04-14T10:58:04.202371+0000","last_active":"2024-04-14T10:58:05.336910+0000","last_peered":"2024-04-14T10:58:05.336910+0000","last_clean":"2024-04-14T10:58:05.336910+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T10:58:05.336910+0000","last_undegraded":"2024-04-14T10:58:05.336910+0000","last_fullsized":"2024-04-14T10:58:05.336910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203456+0000","last_change":"2024-04-14T10:58:04.200986+0000","last_active":"2024-04-14T10:58:05.203456+0000","last_peered":"2024-04-14T10:58:05.203456+0000","last_clean":"2024-04-14T10:58:05.203456+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T10:58:05.203456+0000","last_undegraded":"2024-04-14T10:58:05.203456+0000","last_fullsized":"2024-04-14T10:58:05.203456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570951+0000","last_change":"2024-04-14T10:58:04.211215+0000","last_active":"2024-04-14T10:58:05.570951+0000","last_peered":"2024-04-14T10:58:05.570951+0000","last_clean":"2024-04-14T10:58:05.570951+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T10:58:05.570951+0000","last_undegraded":"2024-04-14T10:58:05.570951+0000","last_fullsized":"2024-04-14T10:58:05.570951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:36.714198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571471+0000","last_change":"2024-04-14T10:58:04.202573+0000","last_active":"2024-04-14T10:58:05.571471+0000","last_peered":"2024-04-14T10:58:05.571471+0000","last_clean":"2024-04-14T10:58:05.571471+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T10:58:05.571471+0000","last_undegraded":"2024-04-14T10:58:05.571471+0000","last_fullsized":"2024-04-14T10:58:05.571471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:41:00.824382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204095+0000","last_change":"2024-04-14T10:58:04.204436+0000","last_active":"2024-04-14T10:58:05.204095+0000","last_peered":"2024-04-14T10:58:05.204095+0000","last_clean":"2024-04-14T10:58:05.204095+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T10:58:05.204095+0000","last_undegraded":"2024-04-14T10:58:05.204095+0000","last_fullsized":"2024-04-14T10:58:05.204095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:57.273798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'5","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.234221+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T10:58:14.234221+0000","last_peered":"2024-04-14T10:58:14.234221+0000","last_clean":"2024-04-14T10:58:14.234221+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T10:58:14.234221+0000","last_undegraded":"2024-04-14T10:58:14.234221+0000","last_fullsized":"2024-04-14T10:58:14.234221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.337012+0000","last_change":"2024-04-14T10:58:04.200296+0000","last_active":"2024-04-14T10:58:05.337012+0000","last_peered":"2024-04-14T10:58:05.337012+0000","last_clean":"2024-04-14T10:58:05.337012+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T10:58:05.337012+0000","last_undegraded":"2024-04-14T10:58:05.337012+0000","last_fullsized":"2024-04-14T10:58:05.337012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253216+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T10:58:20.253216+0000","last_peered":"2024-04-14T10:58:20.253216+0000","last_clean":"2024-04-14T10:58:20.253216+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T10:58:20.253216+0000","last_undegraded":"2024-04-14T10:58:20.253216+0000","last_fullsized":"2024-04-14T10:58:20.253216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253195+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T10:58:20.253195+0000","last_peered":"2024-04-14T10:58:20.253195+0000","last_clean":"2024-04-14T10:58:20.253195+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T10:58:20.253195+0000","last_undegraded":"2024-04-14T10:58:20.253195+0000","last_fullsized":"2024-04-14T10:58:20.253195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.570952+0000","last_change":"2024-04-14T10:58:04.207174+0000","last_active":"2024-04-14T10:58:05.570952+0000","last_peered":"2024-04-14T10:58:05.570952+0000","last_clean":"2024-04-14T10:58:05.570952+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T10:58:05.570952+0000","last_undegraded":"2024-04-14T10:58:05.570952+0000","last_fullsized":"2024-04-14T10:58:05.570952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417427+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T10:58:06.417427+0000","last_peered":"2024-04-14T10:58:06.417427+0000","last_clean":"2024-04-14T10:58:06.417427+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T10:58:06.417427+0000","last_undegraded":"2024-04-14T10:58:06.417427+0000","last_fullsized":"2024-04-14T10:58:06.417427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197451+0000","last_change":"2024-04-14T10:58:04.208273+0000","last_active":"2024-04-14T10:58:05.197451+0000","last_peered":"2024-04-14T10:58:05.197451+0000","last_clean":"2024-04-14T10:58:05.197451+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T10:58:05.197451+0000","last_undegraded":"2024-04-14T10:58:05.197451+0000","last_fullsized":"2024-04-14T10:58:05.197451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:11:50.233725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.234202+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T10:58:14.234202+0000","last_peered":"2024-04-14T10:58:14.234202+0000","last_clean":"2024-04-14T10:58:14.234202+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T10:58:14.234202+0000","last_undegraded":"2024-04-14T10:58:14.234202+0000","last_fullsized":"2024-04-14T10:58:14.234202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.202865+0000","last_change":"2024-04-14T10:58:04.208163+0000","last_active":"2024-04-14T10:58:05.202865+0000","last_peered":"2024-04-14T10:58:05.202865+0000","last_clean":"2024-04-14T10:58:05.202865+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T10:58:05.202865+0000","last_undegraded":"2024-04-14T10:58:05.202865+0000","last_fullsized":"2024-04-14T10:58:05.202865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233942+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T10:58:14.233942+0000","last_peered":"2024-04-14T10:58:14.233942+0000","last_clean":"2024-04-14T10:58:14.233942+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T10:58:14.233942+0000","last_undegraded":"2024-04-14T10:58:14.233942+0000","last_fullsized":"2024-04-14T10:58:14.233942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336933+0000","last_change":"2024-04-14T10:58:04.200870+0000","last_active":"2024-04-14T10:58:05.336933+0000","last_peered":"2024-04-14T10:58:05.336933+0000","last_clean":"2024-04-14T10:58:05.336933+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T10:58:05.336933+0000","last_undegraded":"2024-04-14T10:58:05.336933+0000","last_fullsized":"2024-04-14T10:58:05.336933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:53:53.643468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208572+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T10:58:09.208572+0000","last_peered":"2024-04-14T10:58:09.208572+0000","last_clean":"2024-04-14T10:58:09.208572+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T10:58:09.208572+0000","last_undegraded":"2024-04-14T10:58:09.208572+0000","last_fullsized":"2024-04-14T10:58:09.208572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204453+0000","last_change":"2024-04-14T10:58:04.206792+0000","last_active":"2024-04-14T10:58:05.204453+0000","last_peered":"2024-04-14T10:58:05.204453+0000","last_clean":"2024-04-14T10:58:05.204453+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T10:58:05.204453+0000","last_undegraded":"2024-04-14T10:58:05.204453+0000","last_fullsized":"2024-04-14T10:58:05.204453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:56.649648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.231252+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T10:58:14.231252+0000","last_peered":"2024-04-14T10:58:14.231252+0000","last_clean":"2024-04-14T10:58:14.231252+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T10:58:14.231252+0000","last_undegraded":"2024-04-14T10:58:14.231252+0000","last_fullsized":"2024-04-14T10:58:14.231252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572171+0000","last_change":"2024-04-14T10:58:04.211329+0000","last_active":"2024-04-14T10:58:05.572171+0000","last_peered":"2024-04-14T10:58:05.572171+0000","last_clean":"2024-04-14T10:58:05.572171+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T10:58:05.572171+0000","last_undegraded":"2024-04-14T10:58:05.572171+0000","last_fullsized":"2024-04-14T10:58:05.572171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254160+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T10:58:20.254160+0000","last_peered":"2024-04-14T10:58:20.254160+0000","last_clean":"2024-04-14T10:58:20.254160+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T10:58:20.254160+0000","last_undegraded":"2024-04-14T10:58:20.254160+0000","last_fullsized":"2024-04-14T10:58:20.254160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336696+0000","last_change":"2024-04-14T10:58:04.204963+0000","last_active":"2024-04-14T10:58:05.336696+0000","last_peered":"2024-04-14T10:58:05.336696+0000","last_clean":"2024-04-14T10:58:05.336696+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T10:58:05.336696+0000","last_undegraded":"2024-04-14T10:58:05.336696+0000","last_fullsized":"2024-04-14T10:58:05.336696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232204+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T10:58:14.232204+0000","last_peered":"2024-04-14T10:58:14.232204+0000","last_clean":"2024-04-14T10:58:14.232204+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T10:58:14.232204+0000","last_undegraded":"2024-04-14T10:58:14.232204+0000","last_fullsized":"2024-04-14T10:58:14.232204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572137+0000","last_change":"2024-04-14T10:58:04.211894+0000","last_active":"2024-04-14T10:58:05.572137+0000","last_peered":"2024-04-14T10:58:05.572137+0000","last_clean":"2024-04-14T10:58:05.572137+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T10:58:05.572137+0000","last_undegraded":"2024-04-14T10:58:05.572137+0000","last_fullsized":"2024-04-14T10:58:05.572137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253494+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T10:58:20.253494+0000","last_peered":"2024-04-14T10:58:20.253494+0000","last_clean":"2024-04-14T10:58:20.253494+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T10:58:20.253494+0000","last_undegraded":"2024-04-14T10:58:20.253494+0000","last_fullsized":"2024-04-14T10:58:20.253494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571762+0000","last_change":"2024-04-14T10:58:04.202314+0000","last_active":"2024-04-14T10:58:05.571762+0000","last_peered":"2024-04-14T10:58:05.571762+0000","last_clean":"2024-04-14T10:58:05.571762+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T10:58:05.571762+0000","last_undegraded":"2024-04-14T10:58:05.571762+0000","last_fullsized":"2024-04-14T10:58:05.571762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:36.475984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'15","reported_seq":29,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.260505+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T10:58:20.260505+0000","last_peered":"2024-04-14T10:58:20.260505+0000","last_clean":"2024-04-14T10:58:20.260505+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T10:58:20.260505+0000","last_undegraded":"2024-04-14T10:58:20.260505+0000","last_fullsized":"2024-04-14T10:58:20.260505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571681+0000","last_change":"2024-04-14T10:58:04.213035+0000","last_active":"2024-04-14T10:58:05.571681+0000","last_peered":"2024-04-14T10:58:05.571681+0000","last_clean":"2024-04-14T10:58:05.571681+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T10:58:05.571681+0000","last_undegraded":"2024-04-14T10:58:05.571681+0000","last_fullsized":"2024-04-14T10:58:05.571681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:12.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.204252+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T10:58:09.204252+0000","last_peered":"2024-04-14T10:58:09.204252+0000","last_clean":"2024-04-14T10:58:09.204252+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T10:58:09.204252+0000","last_undegraded":"2024-04-14T10:58:09.204252+0000","last_fullsized":"2024-04-14T10:58:09.204252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572213+0000","last_change":"2024-04-14T10:58:04.211990+0000","last_active":"2024-04-14T10:58:05.572213+0000","last_peered":"2024-04-14T10:58:05.572213+0000","last_clean":"2024-04-14T10:58:05.572213+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T10:58:05.572213+0000","last_undegraded":"2024-04-14T10:58:05.572213+0000","last_fullsized":"2024-04-14T10:58:05.572213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:24.642175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203250+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T10:58:09.203250+0000","last_peered":"2024-04-14T10:58:09.203250+0000","last_clean":"2024-04-14T10:58:09.203250+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T10:58:09.203250+0000","last_undegraded":"2024-04-14T10:58:09.203250+0000","last_fullsized":"2024-04-14T10:58:09.203250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572407+0000","last_change":"2024-04-14T10:58:04.212293+0000","last_active":"2024-04-14T10:58:05.572407+0000","last_peered":"2024-04-14T10:58:05.572407+0000","last_clean":"2024-04-14T10:58:05.572407+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T10:58:05.572407+0000","last_undegraded":"2024-04-14T10:58:05.572407+0000","last_fullsized":"2024-04-14T10:58:05.572407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:59.711012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422915+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T10:58:06.422915+0000","last_peered":"2024-04-14T10:58:06.422915+0000","last_clean":"2024-04-14T10:58:06.422915+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T10:58:06.422915+0000","last_undegraded":"2024-04-14T10:58:06.422915+0000","last_fullsized":"2024-04-14T10:58:06.422915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203598+0000","last_change":"2024-04-14T10:58:04.202541+0000","last_active":"2024-04-14T10:58:05.203598+0000","last_peered":"2024-04-14T10:58:05.203598+0000","last_clean":"2024-04-14T10:58:05.203598+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T10:58:05.203598+0000","last_undegraded":"2024-04-14T10:58:05.203598+0000","last_fullsized":"2024-04-14T10:58:05.203598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:49:26.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.256163+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T10:58:20.256163+0000","last_peered":"2024-04-14T10:58:20.256163+0000","last_clean":"2024-04-14T10:58:20.256163+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T10:58:20.256163+0000","last_undegraded":"2024-04-14T10:58:20.256163+0000","last_fullsized":"2024-04-14T10:58:20.256163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.572155+0000","last_change":"2024-04-14T10:58:04.213775+0000","last_active":"2024-04-14T10:58:05.572155+0000","last_peered":"2024-04-14T10:58:05.572155+0000","last_clean":"2024-04-14T10:58:05.572155+0000","last_became_active":"2024-04-14T10:58:04.213485+0000","last_became_peered":"2024-04-14T10:58:04.213485+0000","last_unstale":"2024-04-14T10:58:05.572155+0000","last_undegraded":"2024-04-14T10:58:05.572155+0000","last_fullsized":"2024-04-14T10:58:05.572155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233698+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T10:58:14.233698+0000","last_peered":"2024-04-14T10:58:14.233698+0000","last_clean":"2024-04-14T10:58:14.233698+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T10:58:14.233698+0000","last_undegraded":"2024-04-14T10:58:14.233698+0000","last_fullsized":"2024-04-14T10:58:14.233698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571495+0000","last_change":"2024-04-14T10:58:04.205614+0000","last_active":"2024-04-14T10:58:05.571495+0000","last_peered":"2024-04-14T10:58:05.571495+0000","last_clean":"2024-04-14T10:58:05.571495+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T10:58:05.571495+0000","last_undegraded":"2024-04-14T10:58:05.571495+0000","last_fullsized":"2024-04-14T10:58:05.571495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:03:58.866856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.257601+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T10:58:20.257601+0000","last_peered":"2024-04-14T10:58:20.257601+0000","last_clean":"2024-04-14T10:58:20.257601+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T10:58:20.257601+0000","last_undegraded":"2024-04-14T10:58:20.257601+0000","last_fullsized":"2024-04-14T10:58:20.257601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336583+0000","last_change":"2024-04-14T10:58:04.196892+0000","last_active":"2024-04-14T10:58:05.336583+0000","last_peered":"2024-04-14T10:58:05.336583+0000","last_clean":"2024-04-14T10:58:05.336583+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T10:58:05.336583+0000","last_undegraded":"2024-04-14T10:58:05.336583+0000","last_fullsized":"2024-04-14T10:58:05.336583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:12:12.480196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.255438+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T10:58:20.255438+0000","last_peered":"2024-04-14T10:58:20.255438+0000","last_clean":"2024-04-14T10:58:20.255438+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T10:58:20.255438+0000","last_undegraded":"2024-04-14T10:58:20.255438+0000","last_fullsized":"2024-04-14T10:58:20.255438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197467+0000","last_change":"2024-04-14T10:58:04.208032+0000","last_active":"2024-04-14T10:58:05.197467+0000","last_peered":"2024-04-14T10:58:05.197467+0000","last_clean":"2024-04-14T10:58:05.197467+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T10:58:05.197467+0000","last_undegraded":"2024-04-14T10:58:05.197467+0000","last_fullsized":"2024-04-14T10:58:05.197467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417473+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T10:58:06.417473+0000","last_peered":"2024-04-14T10:58:06.417473+0000","last_clean":"2024-04-14T10:58:06.417473+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T10:58:06.417473+0000","last_undegraded":"2024-04-14T10:58:06.417473+0000","last_fullsized":"2024-04-14T10:58:06.417473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204030+0000","last_change":"2024-04-14T10:58:04.205260+0000","last_active":"2024-04-14T10:58:05.204030+0000","last_peered":"2024-04-14T10:58:05.204030+0000","last_clean":"2024-04-14T10:58:05.204030+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T10:58:05.204030+0000","last_undegraded":"2024-04-14T10:58:05.204030+0000","last_fullsized":"2024-04-14T10:58:05.204030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:57.840839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197589+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T10:58:05.197589+0000","last_peered":"2024-04-14T10:58:05.197589+0000","last_clean":"2024-04-14T10:58:05.197589+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T10:58:05.197589+0000","last_undegraded":"2024-04-14T10:58:05.197589+0000","last_fullsized":"2024-04-14T10:58:05.197589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203218+0000","last_change":"2024-04-14T10:58:04.200654+0000","last_active":"2024-04-14T10:58:05.203218+0000","last_peered":"2024-04-14T10:58:05.203218+0000","last_clean":"2024-04-14T10:58:05.203218+0000","last_became_active":"2024-04-14T10:58:04.200367+0000","last_became_peered":"2024-04-14T10:58:04.200367+0000","last_unstale":"2024-04-14T10:58:05.203218+0000","last_undegraded":"2024-04-14T10:58:05.203218+0000","last_fullsized":"2024-04-14T10:58:05.203218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.417091+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T10:58:06.417091+0000","last_peered":"2024-04-14T10:58:06.417091+0000","last_clean":"2024-04-14T10:58:06.417091+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T10:58:06.417091+0000","last_undegraded":"2024-04-14T10:58:06.417091+0000","last_fullsized":"2024-04-14T10:58:06.417091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.197558+0000","last_change":"2024-04-14T10:58:04.202947+0000","last_active":"2024-04-14T10:58:05.197558+0000","last_peered":"2024-04-14T10:58:05.197558+0000","last_clean":"2024-04-14T10:58:05.197558+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T10:58:05.197558+0000","last_undegraded":"2024-04-14T10:58:05.197558+0000","last_fullsized":"2024-04-14T10:58:05.197558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:26:50.222177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254084+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T10:58:20.254084+0000","last_peered":"2024-04-14T10:58:20.254084+0000","last_clean":"2024-04-14T10:58:20.254084+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T10:58:20.254084+0000","last_undegraded":"2024-04-14T10:58:20.254084+0000","last_fullsized":"2024-04-14T10:58:20.254084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571517+0000","last_change":"2024-04-14T10:58:04.209362+0000","last_active":"2024-04-14T10:58:05.571517+0000","last_peered":"2024-04-14T10:58:05.571517+0000","last_clean":"2024-04-14T10:58:05.571517+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T10:58:05.571517+0000","last_undegraded":"2024-04-14T10:58:05.571517+0000","last_fullsized":"2024-04-14T10:58:05.571517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:08.960950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232877+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T10:58:14.232877+0000","last_peered":"2024-04-14T10:58:14.232877+0000","last_clean":"2024-04-14T10:58:14.232877+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T10:58:14.232877+0000","last_undegraded":"2024-04-14T10:58:14.232877+0000","last_fullsized":"2024-04-14T10:58:14.232877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336941+0000","last_change":"2024-04-14T10:58:04.205399+0000","last_active":"2024-04-14T10:58:05.336941+0000","last_peered":"2024-04-14T10:58:05.336941+0000","last_clean":"2024-04-14T10:58:05.336941+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T10:58:05.336941+0000","last_undegraded":"2024-04-14T10:58:05.336941+0000","last_fullsized":"2024-04-14T10:58:05.336941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232381+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T10:58:14.232381+0000","last_peered":"2024-04-14T10:58:14.232381+0000","last_clean":"2024-04-14T10:58:14.232381+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T10:58:14.232381+0000","last_undegraded":"2024-04-14T10:58:14.232381+0000","last_fullsized":"2024-04-14T10:58:14.232381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204070+0000","last_change":"2024-04-14T10:58:04.207390+0000","last_active":"2024-04-14T10:58:05.204070+0000","last_peered":"2024-04-14T10:58:05.204070+0000","last_clean":"2024-04-14T10:58:05.204070+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T10:58:05.204070+0000","last_undegraded":"2024-04-14T10:58:05.204070+0000","last_fullsized":"2024-04-14T10:58:05.204070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:40.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.232759+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T10:58:14.232759+0000","last_peered":"2024-04-14T10:58:14.232759+0000","last_clean":"2024-04-14T10:58:14.232759+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T10:58:14.232759+0000","last_undegraded":"2024-04-14T10:58:14.232759+0000","last_fullsized":"2024-04-14T10:58:14.232759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571047+0000","last_change":"2024-04-14T10:58:04.201921+0000","last_active":"2024-04-14T10:58:05.571047+0000","last_peered":"2024-04-14T10:58:05.571047+0000","last_clean":"2024-04-14T10:58:05.571047+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T10:58:05.571047+0000","last_undegraded":"2024-04-14T10:58:05.571047+0000","last_fullsized":"2024-04-14T10:58:05.571047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:06.422844+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T10:58:06.422844+0000","last_peered":"2024-04-14T10:58:06.422844+0000","last_clean":"2024-04-14T10:58:06.422844+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T10:58:06.422844+0000","last_undegraded":"2024-04-14T10:58:06.422844+0000","last_fullsized":"2024-04-14T10:58:06.422844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571427+0000","last_change":"2024-04-14T10:58:04.203248+0000","last_active":"2024-04-14T10:58:05.571427+0000","last_peered":"2024-04-14T10:58:05.571427+0000","last_clean":"2024-04-14T10:58:05.571427+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T10:58:05.571427+0000","last_undegraded":"2024-04-14T10:58:05.571427+0000","last_fullsized":"2024-04-14T10:58:05.571427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:19.858116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:14.233983+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T10:58:14.233983+0000","last_peered":"2024-04-14T10:58:14.233983+0000","last_clean":"2024-04-14T10:58:14.233983+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T10:58:14.233983+0000","last_undegraded":"2024-04-14T10:58:14.233983+0000","last_fullsized":"2024-04-14T10:58:14.233983+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571662+0000","last_change":"2024-04-14T10:58:04.207327+0000","last_active":"2024-04-14T10:58:05.571662+0000","last_peered":"2024-04-14T10:58:05.571662+0000","last_clean":"2024-04-14T10:58:05.571662+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T10:58:05.571662+0000","last_undegraded":"2024-04-14T10:58:05.571662+0000","last_fullsized":"2024-04-14T10:58:05.571662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:41:37.531862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.204099+0000","last_change":"2024-04-14T10:58:04.197961+0000","last_active":"2024-04-14T10:58:05.204099+0000","last_peered":"2024-04-14T10:58:05.204099+0000","last_clean":"2024-04-14T10:58:05.204099+0000","last_became_active":"2024-04-14T10:58:04.197576+0000","last_became_peered":"2024-04-14T10:58:04.197576+0000","last_unstale":"2024-04-14T10:58:05.204099+0000","last_undegraded":"2024-04-14T10:58:05.204099+0000","last_fullsized":"2024-04-14T10:58:05.204099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:09:32.266301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.208343+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T10:58:09.208343+0000","last_peered":"2024-04-14T10:58:09.208343+0000","last_clean":"2024-04-14T10:58:09.208343+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T10:58:09.208343+0000","last_undegraded":"2024-04-14T10:58:09.208343+0000","last_fullsized":"2024-04-14T10:58:09.208343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.203463+0000","last_change":"2024-04-14T10:58:04.198245+0000","last_active":"2024-04-14T10:58:05.203463+0000","last_peered":"2024-04-14T10:58:05.203463+0000","last_clean":"2024-04-14T10:58:05.203463+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T10:58:05.203463+0000","last_undegraded":"2024-04-14T10:58:05.203463+0000","last_fullsized":"2024-04-14T10:58:05.203463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.695990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.253115+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T10:58:20.253115+0000","last_peered":"2024-04-14T10:58:20.253115+0000","last_clean":"2024-04-14T10:58:20.253115+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T10:58:20.253115+0000","last_undegraded":"2024-04-14T10:58:20.253115+0000","last_fullsized":"2024-04-14T10:58:20.253115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.336885+0000","last_change":"2024-04-14T10:58:04.200948+0000","last_active":"2024-04-14T10:58:05.336885+0000","last_peered":"2024-04-14T10:58:05.336885+0000","last_clean":"2024-04-14T10:58:05.336885+0000","last_became_active":"2024-04-14T10:58:04.200647+0000","last_became_peered":"2024-04-14T10:58:04.200647+0000","last_unstale":"2024-04-14T10:58:05.336885+0000","last_undegraded":"2024-04-14T10:58:05.336885+0000","last_fullsized":"2024-04-14T10:58:05.336885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:00:49.266928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:09.203010+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T10:58:09.203010+0000","last_peered":"2024-04-14T10:58:09.203010+0000","last_clean":"2024-04-14T10:58:09.203010+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T10:58:09.203010+0000","last_undegraded":"2024-04-14T10:58:09.203010+0000","last_fullsized":"2024-04-14T10:58:09.203010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:05.571302+0000","last_change":"2024-04-14T10:58:04.206540+0000","last_active":"2024-04-14T10:58:05.571302+0000","last_peered":"2024-04-14T10:58:05.571302+0000","last_clean":"2024-04-14T10:58:05.571302+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T10:58:05.571302+0000","last_undegraded":"2024-04-14T10:58:05.571302+0000","last_fullsized":"2024-04-14T10:58:05.571302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:04.440463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-14T10:58:20.254806+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T10:58:20.254806+0000","last_peered":"2024-04-14T10:58:20.254806+0000","last_clean":"2024-04-14T10:58:20.254806+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T10:58:20.254806+0000","last_undegraded":"2024-04-14T10:58:20.254806+0000","last_fullsized":"2024-04-14T10:58:20.254806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":125,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":109,"ondisk_log_size":109,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":819200,"data_stored":662618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":73224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":72312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":71648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":73258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":815104,"data_stored":661962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:58:32.474 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:32.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.613+0000 7fddf7a88640 1 Processor -- start 2024-04-14T10:58:32.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.613+0000 7fddf7a88640 1 -- start start 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf7a88640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fddf0152fd0 0x7fddf00c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf7a88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 0x7fddf00c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf7a88640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf0159740 con 0x7fddf0152bf0 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf7a88640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fddf0159510 con 0x7fddf0152fd0 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf7a88640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fddf00c8960 con 0x7fddf006f790 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf5824640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fddf0152bf0 0x7fddf006f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46444/0 (socket says 172.21.15.84:46444) 2024-04-14T10:58:32.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf5824640 1 -- 172.21.15.84:0/3181809905 learned_addr learned my addr 172.21.15.84:0/3181809905 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf5023640 1 --2- 172.21.15.84:0/3181809905 >> v2:172.21.15.175:3300/0 conn(0x7fddf0152fd0 0x7fddf00c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf6025640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 0x7fddf00c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690744817 0 0) 0x7fddf0159740 con 0x7fddf0152bf0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdddc003520 con 0x7fddf0152bf0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2772202899 0 0) 0x7fdddc003520 con 0x7fddf0152bf0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 msgr2=0x7fddf00c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 0x7fddf00c4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 >> v2:172.21.15.175:3300/0 conn(0x7fddf0152fd0 msgr2=0x7fddf00c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 --2- 172.21.15.84:0/3181809905 >> v2:172.21.15.175:3300/0 conn(0x7fddf0152fd0 0x7fddf00c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf0159a00 con 0x7fddf0152bf0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7fddec001670 con 0x7fddf0152bf0 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 >> v1:172.21.15.84:6789/0 conn(0x7fddf0152bf0 legacy=0x7fddf006f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdddc0039e0 0x7fdddc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdddc004800 0x7fdddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 0x7fdddc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddf00c8960 con 0x7fdddc004800 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.614+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc00b9c0 con 0x7fdddc0039e0 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdddc00bb40 con 0x7fddf006f790 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5023640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdddc004800 0x7fdddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5824640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdddc0039e0 0x7fdddc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf6025640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 0x7fdddc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5023640 1 -- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 msgr2=0x7fdddc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5023640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fddf006f790 0x7fdddc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5023640 1 -- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdddc0039e0 msgr2=0x7fdddc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5023640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdddc0039e0 0x7fdddc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.615+0000 7fddf5023640 1 -- 172.21.15.84:0/3181809905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc003520 con 0x7fdddc004800 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf5023640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdddc004800 0x7fdddc004c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009ac0 tx=0x7fdddc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540c102277c179e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0039070 con 0x7fdddc004800 2024-04-14T10:58:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde002c710 con 0x7fdddc004800 2024-04-14T10:58:32.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf4822640 1 -- 172.21.15.84:0/3181809905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0009690 con 0x7fdddc004800 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf7a88640 1 -- 172.21.15.84:0/3181809905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdddc004800 msgr2=0x7fdddc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf7a88640 1 --2- 172.21.15.84:0/3181809905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdddc004800 0x7fdddc004c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009ac0 tx=0x7fdddc005830 comp rx=0 tx=0).stop 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf6025640 1 -- 172.21.15.84:0/3181809905 reap_dead start 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf7a88640 1 -- 172.21.15.84:0/3181809905 shutdown_connections 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf7a88640 1 -- 172.21.15.84:0/3181809905 >> 172.21.15.84:0/3181809905 conn(0x7fddf00cc150 msgr2=0x7fddf00cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf7a88640 1 -- 172.21.15.84:0/3181809905 shutdown_connections 2024-04-14T10:58:32.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.616+0000 7fddf7a88640 1 -- 172.21.15.84:0/3181809905 wait complete. 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.617+0000 7fddf7a88640 1 Processor -- start 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.617+0000 7fddf7a88640 1 -- start start 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf7a88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdddc004800 0x7fddf01ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf7a88640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf0148b00 0x7fddf014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf7a88640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 0x7fddf00c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf7a88640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddf006eb60 con 0x7fddf014baa0 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf7a88640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fddf00c8680 con 0x7fddf0148b00 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf7a88640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fddf00c64f0 con 0x7fdddc004800 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf6025640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 0x7fddf00c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf6025640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 0x7fddf00c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53474/0 (socket says 172.21.15.84:53474) 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf6025640 1 -- 172.21.15.84:0/4026144962 learned_addr learned my addr 172.21.15.84:0/4026144962 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf5824640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdddc004800 0x7fddf01ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf5023640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf0148b00 0x7fddf014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf6025640 1 -- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdddc004800 msgr2=0x7fddf01ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.618+0000 7fddf6025640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdddc004800 0x7fddf01ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fddf6025640 1 -- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf0148b00 msgr2=0x7fddf014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fddf6025640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf0148b00 0x7fddf014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fddf6025640 1 -- 172.21.15.84:0/4026144962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf01eefd0 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fddf6025640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 0x7fddf00c6840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdde8011bf0 tx=0x7fdde800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde800fd10 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde801d070 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf0149f90 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8015670 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.619+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf014a550 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.620+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf0069c30 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.620+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdde8015810 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.621+0000 7fdde67fc640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fddd406c8f0 0x7fddd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.621+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdde808c270 con 0x7fddf014baa0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.621+0000 7fddf5824640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fddd406c8f0 0x7fddd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.621+0000 7fddf5824640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fddd406c8f0 0x7fddd406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fddec0017e0 tx=0x7fddec0015b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.625+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fdde8010040 con 0x7fddf014baa0 2024-04-14T10:58:32.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.838+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddf00ca030 con 0x7fddf014baa0 2024-04-14T10:58:32.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.838+0000 7fdde67fc640 1 -- 172.21.15.84:0/4026144962 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7fdde805a6a0 con 0x7fddf014baa0 2024-04-14T10:58:32.837 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:32.837 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T10:58:32.838 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T10:58:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fddd406c8f0 msgr2=0x7fddd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fddd406c8f0 0x7fddd406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fddec0017e0 tx=0x7fddec0015b0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 msgr2=0x7fddf00c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 0x7fddf00c6840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdde8011bf0 tx=0x7fdde800f1b0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 shutdown_connections 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fddd406c8f0 0x7fddd406edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf014baa0 0x7fddf00c6840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fddf0148b00 0x7fddf014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 --2- 172.21.15.84:0/4026144962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdddc004800 0x7fddf01ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.840+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 >> 172.21.15.84:0/4026144962 conn(0x7fddf00cc150 msgr2=0x7fddf00c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.841+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 shutdown_connections 2024-04-14T10:58:32.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.841+0000 7fddf7a88640 1 -- 172.21.15.84:0/4026144962 wait complete. 2024-04-14T10:58:32.850 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:32.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 Processor -- start 2024-04-14T10:58:32.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 -- start start 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff10415a900 0x7ff104073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff104150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff104073bb0 con 0x7ff1040721f0 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff1040728d0 con 0x7ff10415a900 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.951+0000 7ff10b0c0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff10406fe50 con 0x7ff1040c6b50 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff10965d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff1040721f0 0x7ff10415ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46448/0 (socket says 172.21.15.84:46448) 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff10965d640 1 -- 172.21.15.84:0/3585752836 learned_addr learned my addr 172.21.15.84:0/3585752836 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438803996 0 0) 0x7ff104073bb0 con 0x7ff1040721f0 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f0004630 con 0x7ff1040721f0 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff103fff640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff104150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff108e5c640 1 --2- 172.21.15.84:0/3585752836 >> v2:172.21.15.175:3300/0 conn(0x7ff10415a900 0x7ff104073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268824436 0 0) 0x7ff0f0004630 con 0x7ff1040721f0 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 msgr2=0x7ff104150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff104150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 >> v2:172.21.15.175:3300/0 conn(0x7ff10415a900 msgr2=0x7ff104073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 --2- 172.21.15.84:0/3585752836 >> v2:172.21.15.175:3300/0 conn(0x7ff10415a900 0x7ff104073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff104070130 con 0x7ff1040721f0 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7ff0f4001670 con 0x7ff1040721f0 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff103fff640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff104150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff108e5c640 1 --2- 172.21.15.84:0/3585752836 >> v2:172.21.15.175:3300/0 conn(0x7ff10415a900 0x7ff104073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 >> v1:172.21.15.84:6789/0 conn(0x7ff1040721f0 legacy=0x7ff10415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff0f0004ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff0f0005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f0005e50 0x7ff0f00062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040728d0 con 0x7ff0f00050b0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff10406fe50 con 0x7ff0f0005e50 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f00035a0 con 0x7ff1040c6b50 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff103fff640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff0f0005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff108e5c640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff0f0004ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.952+0000 7ff10965d640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f0005e50 0x7ff0f00062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff103fff640 1 -- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 msgr2=0x7ff0f0004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff103fff640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1040c6b50 0x7ff0f0004ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff103fff640 1 -- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f0005e50 msgr2=0x7ff0f00062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff103fff640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0f0005e50 0x7ff0f00062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff103fff640 1 -- 172.21.15.84:0/3585752836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0004630 con 0x7ff0f00050b0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff103fff640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff0f0005910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0098a0 tx=0x7ff0f0006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453f8aae8856af92 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00f040 con 0x7ff0f00050b0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec004230 con 0x7ff0f00050b0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.953+0000 7ff1037fe640 1 -- 172.21.15.84:0/3585752836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec003610 con 0x7ff0f00050b0 2024-04-14T10:58:32.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10b0c0640 1 -- 172.21.15.84:0/3585752836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 msgr2=0x7ff0f0005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/3585752836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff0f0005910 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0098a0 tx=0x7ff0f0006940 comp rx=0 tx=0).stop 2024-04-14T10:58:32.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10965d640 1 -- 172.21.15.84:0/3585752836 reap_dead start 2024-04-14T10:58:32.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10b0c0640 1 -- 172.21.15.84:0/3585752836 shutdown_connections 2024-04-14T10:58:32.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10b0c0640 1 -- 172.21.15.84:0/3585752836 >> 172.21.15.84:0/3585752836 conn(0x7ff1040cc150 msgr2=0x7ff1040cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:32.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10b0c0640 1 -- 172.21.15.84:0/3585752836 shutdown_connections 2024-04-14T10:58:32.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.954+0000 7ff10b0c0640 1 -- 172.21.15.84:0/3585752836 wait complete. 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.955+0000 7ff10b0c0640 1 Processor -- start 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.955+0000 7ff10b0c0640 1 -- start start 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10b0c0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff1041f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10b0c0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10414fa00 0x7ff10414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10b0c0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff10414f4c0 0x7ff104147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10b0c0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff104073150 con 0x7ff0f00050b0 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10b0c0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff104072e70 con 0x7ff10414fa00 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10b0c0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1040718c0 con 0x7ff10414f4c0 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff1041f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff1041f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53478/0 (socket says 172.21.15.84:53478) 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 -- 172.21.15.84:0/1338857941 learned_addr learned my addr 172.21.15.84:0/1338857941 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff10965d640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff10414f4c0 0x7ff104147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff103fff640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10414fa00 0x7ff10414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 -- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff10414f4c0 msgr2=0x7ff104147c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff10414f4c0 0x7ff104147c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 -- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10414fa00 msgr2=0x7ff10414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10414fa00 0x7ff10414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff108e5c640 1 -- 172.21.15.84:0/1338857941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff104158300 con 0x7ff0f00050b0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.956+0000 7ff103fff640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10414fa00 0x7ff10414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.957+0000 7ff108e5c640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff1041f4920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc010410 tx=0x7ff0fc0108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.957+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc003990 con 0x7ff0f00050b0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.957+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc003b30 con 0x7ff0f00050b0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.957+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff104153c30 con 0x7ff0f00050b0 2024-04-14T10:58:32.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.957+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc003d20 con 0x7ff0f00050b0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.957+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff104153ed0 con 0x7ff0f00050b0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.958+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff104069c30 con 0x7ff0f00050b0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.958+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0fc01e020 con 0x7ff0f00050b0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.959+0000 7ff1017fa640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff0e406c920 0x7ff0e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.959+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff0fc08c5a0 con 0x7ff0f00050b0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.959+0000 7ff103fff640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff0e406c920 0x7ff0e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.959+0000 7ff103fff640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff0e406c920 0x7ff0e406ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec035000 tx=0x7ff0ec03a040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:32.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:32.963+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff0fc025020 con 0x7ff0f00050b0 2024-04-14T10:58:33.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.137+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff104154ac0 con 0x7ff0f00050b0 2024-04-14T10:58:33.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.138+0000 7ff1017fa640 1 -- 172.21.15.84:0/1338857941 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7ff0fc05a9d0 con 0x7ff0f00050b0 2024-04-14T10:58:33.137 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:33.137 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff0e406c920 msgr2=0x7ff0e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff0e406c920 0x7ff0e406ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec035000 tx=0x7ff0ec03a040 comp rx=0 tx=0).stop 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 msgr2=0x7ff1041f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff1041f4920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc010410 tx=0x7ff0fc0108d0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 shutdown_connections 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff0e406c920 0x7ff0e406ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff10414f4c0 0x7ff104147c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff10414fa00 0x7ff10414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 --2- 172.21.15.84:0/1338857941 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0f00050b0 0x7ff1041f4920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 >> 172.21.15.84:0/1338857941 conn(0x7ff1040cc150 msgr2=0x7ff1040c54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:33.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 shutdown_connections 2024-04-14T10:58:33.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.140+0000 7ff10b0c0640 1 -- 172.21.15.84:0/1338857941 wait complete. 2024-04-14T10:58:33.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:58:33.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:58:33.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.255+0000 7fd7d146d640 1 Processor -- start 2024-04-14T10:58:33.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.255+0000 7fd7d146d640 1 -- start start 2024-04-14T10:58:33.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7d146d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7cc0ccbf0 0x7fd7cc0c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7d146d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc15e910 con 0x7fd7cc0ccfd0 2024-04-14T10:58:33.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7d146d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc15ebf0 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7d146d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc0c45f0 con 0x7fd7cc0ccbf0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7caffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fd7cc0ccbf0 0x7fd7cc0c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7c3fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fd7cc0ccfd0 0x7fd7cc154c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46460/0 (socket says 172.21.15.84:46460) 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7c3fff640 1 -- 172.21.15.84:0/3737523549 learned_addr learned my addr 172.21.15.84:0/3737523549 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7caffd640 1 -- 172.21.15.84:0/3737523549 >> v1:172.21.15.175:6789/0 conn(0x7fd7cc15e3b0 legacy=0x7fd7cc0c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7caffd640 1 -- 172.21.15.84:0/3737523549 >> v1:172.21.15.84:6789/0 conn(0x7fd7cc0ccfd0 legacy=0x7fd7cc154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7caffd640 1 -- 172.21.15.84:0/3737523549 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc15eed0 con 0x7fd7cc0ccbf0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.256+0000 7fd7ca7fc640 1 -- 172.21.15.84:0/3737523549 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475536404 0 0) 0x7fd7cc15e910 con 0x7fd7cc0ccfd0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.257+0000 7fd7caffd640 1 --2- 172.21.15.84:0/3737523549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc0c4a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097a0 tx=0x7fd7bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcba833d3f4af07 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.257+0000 7fd7ca7fc640 1 -- 172.21.15.84:0/3737523549 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc034070 con 0x7fd7cc0ccbf0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.257+0000 7fd7ca7fc640 1 -- 172.21.15.84:0/3737523549 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc030610 con 0x7fd7cc0ccbf0 2024-04-14T10:58:33.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.257+0000 7fd7ca7fc640 1 -- 172.21.15.84:0/3737523549 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0309e0 con 0x7fd7cc0ccbf0 2024-04-14T10:58:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 -- 172.21.15.84:0/3737523549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0ccbf0 msgr2=0x7fd7cc0c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 --2- 172.21.15.84:0/3737523549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc0c4a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0097a0 tx=0x7fd7bc02b960 comp rx=0 tx=0).stop 2024-04-14T10:58:33.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 -- 172.21.15.84:0/3737523549 shutdown_connections 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 --2- 172.21.15.84:0/3737523549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc0c4a80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 -- 172.21.15.84:0/3737523549 >> 172.21.15.84:0/3737523549 conn(0x7fd7cc067900 msgr2=0x7fd7cc06fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 -- 172.21.15.84:0/3737523549 shutdown_connections 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.258+0000 7fd7d146d640 1 -- 172.21.15.84:0/3737523549 wait complete. 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.259+0000 7fd7d146d640 1 Processor -- start 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.259+0000 7fd7d146d640 1 -- start start 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc1f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7cc0ccfd0 0x7fd7cc14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 0x7fd7cc1f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc155390 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc15f1b0 con 0x7fd7cc0ccbf0 2024-04-14T10:58:33.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc155510 con 0x7fd7cc0ccfd0 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 0x7fd7cc1f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 0x7fd7cc1f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53498/0 (socket says 172.21.15.84:53498) 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 -- 172.21.15.84:0/2087671333 learned_addr learned my addr 172.21.15.84:0/2087671333 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7caffd640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc1f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7c3fff640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7cc0ccfd0 0x7fd7cc14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 -- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7cc0ccfd0 msgr2=0x7fd7cc14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7cc0ccfd0 0x7fd7cc14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 -- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7cc0ccbf0 msgr2=0x7fd7cc1f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc1f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 -- 172.21.15.84:0/2087671333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc15a800 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7cb7fe640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 0x7fd7cc1f13d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b9a0 tx=0x7fd7c400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4019070 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c400cba0 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc1f4430 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4014440 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.260+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc15ad60 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.262+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc069b20 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.262+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7c401c070 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.262+0000 7fd7c37fe640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7ac06c920 0x7fd7ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.262+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c408b760 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.262+0000 7fd7caffd640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7ac06c920 0x7fd7ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.263+0000 7fd7caffd640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7ac06c920 0x7fd7ac06ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc036000 tx=0x7fd7bc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.267+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fd7c4059b90 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.443+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd7cc0701e0 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.443+0000 7fd7c37fe640 1 -- 172.21.15.84:0/2087671333 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fd7c4059490 con 0x7fd7cc15e3b0 2024-04-14T10:58:33.442 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T10:58:33.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7ac06c920 msgr2=0x7fd7ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7ac06c920 0x7fd7ac06ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc036000 tx=0x7fd7bc03b040 comp rx=0 tx=0).stop 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 msgr2=0x7fd7cc1f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 0x7fd7cc1f13d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b9a0 tx=0x7fd7c400be60 comp rx=0 tx=0).stop 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 shutdown_connections 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd7ac06c920 0x7fd7ac06ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.445+0000 7fd7d146d640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd7cc15e3b0 0x7fd7cc1f13d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.446+0000 7fd7d146d640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7cc0ccfd0 0x7fd7cc14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.446+0000 7fd7d146d640 1 --2- 172.21.15.84:0/2087671333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7cc0ccbf0 0x7fd7cc1f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.446+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 >> 172.21.15.84:0/2087671333 conn(0x7fd7cc067900 msgr2=0x7fd7cc0c35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:33.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.446+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 shutdown_connections 2024-04-14T10:58:33.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.446+0000 7fd7d146d640 1 -- 172.21.15.84:0/2087671333 wait complete. 2024-04-14T10:58:33.455 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:58:33.517 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:58:33.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:58:33.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.563+0000 7f6224c76640 1 Processor -- start 2024-04-14T10:58:33.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.563+0000 7f6224c76640 1 -- start start 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f6224c76640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6220155060 0x7f622015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f6224c76640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622015f240 con 0x7f62200cafb0 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f6224c76640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622006c560 con 0x7f62200cc2e0 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f6224c76640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f62200cbe50 con 0x7f6220155060 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f6217fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f62200cafb0 0x7f62200ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46466/0 (socket says 172.21.15.84:46466) 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f6217fff640 1 -- 172.21.15.84:0/1339987578 learned_addr learned my addr 172.21.15.84:0/1339987578 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621e59c640 1 --2- 172.21.15.84:0/1339987578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6220155060 0x7f622015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621dd9b640 1 -- 172.21.15.84:0/1339987578 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576928377 0 0) 0x7f622015f240 con 0x7f62200cafb0 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621dd9b640 1 -- 172.21.15.84:0/1339987578 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620c003520 con 0x7f62200cafb0 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621e59c640 1 -- 172.21.15.84:0/1339987578 >> v1:172.21.15.175:6789/0 conn(0x7f62200cc2e0 legacy=0x7f62200cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621dd9b640 1 -- 172.21.15.84:0/1339987578 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191997181 0 0) 0x7f622006c560 con 0x7f62200cc2e0 2024-04-14T10:58:33.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621e59c640 1 -- 172.21.15.84:0/1339987578 >> v1:172.21.15.84:6789/0 conn(0x7f62200cafb0 legacy=0x7f62200ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.564+0000 7f621e59c640 1 -- 172.21.15.84:0/1339987578 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6220155440 con 0x7f6220155060 2024-04-14T10:58:33.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.565+0000 7f621e59c640 1 --2- 172.21.15.84:0/1339987578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6220155060 0x7f622015ed00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f62100097d0 tx=0x7f621002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb13657f0097df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.565+0000 7f621dd9b640 1 -- 172.21.15.84:0/1339987578 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210034070 con 0x7f6220155060 2024-04-14T10:58:33.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.565+0000 7f621dd9b640 1 -- 172.21.15.84:0/1339987578 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210030880 con 0x7f6220155060 2024-04-14T10:58:33.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.565+0000 7f621dd9b640 1 -- 172.21.15.84:0/1339987578 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210030c30 con 0x7f6220155060 2024-04-14T10:58:33.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 -- 172.21.15.84:0/1339987578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6220155060 msgr2=0x7f622015ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 --2- 172.21.15.84:0/1339987578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6220155060 0x7f622015ed00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f62100097d0 tx=0x7f621002b9c0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 -- 172.21.15.84:0/1339987578 shutdown_connections 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 --2- 172.21.15.84:0/1339987578 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6220155060 0x7f622015ed00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 -- 172.21.15.84:0/1339987578 >> 172.21.15.84:0/1339987578 conn(0x7f6220067720 msgr2=0x7f622006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 -- 172.21.15.84:0/1339987578 shutdown_connections 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.566+0000 7f6224c76640 1 -- 172.21.15.84:0/1339987578 wait complete. 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.567+0000 7f6224c76640 1 Processor -- start 2024-04-14T10:58:33.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.567+0000 7f6224c76640 1 -- start start 2024-04-14T10:58:33.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 0x7f622014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62200cc2e0 0x7f62201f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6220155060 0x7f62201f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f622015b5d0 con 0x7f62200cafb0 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f622015b2f0 con 0x7f6220155060 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f622015b8b0 con 0x7f62200cc2e0 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 0x7f622014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 0x7f622014a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53514/0 (socket says 172.21.15.84:53514) 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 -- 172.21.15.84:0/2744381855 learned_addr learned my addr 172.21.15.84:0/2744381855 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6217fff640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62200cc2e0 0x7f62201f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621ed9d640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6220155060 0x7f62201f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 -- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62200cc2e0 msgr2=0x7f62201f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62200cc2e0 0x7f62201f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 -- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6220155060 msgr2=0x7f62201f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6220155060 0x7f62201f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 -- 172.21.15.84:0/2744381855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6220155c80 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f621e59c640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 0x7f622014a120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f621002ba00 tx=0x7f62100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210047070 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6210030680 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210034040 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6220155f60 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.568+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6220156520 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.569+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6220150a60 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.570+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f621004a070 con 0x7f62200cafb0 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.570+0000 7f6216ffd640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f620006c8f0 0x7f620006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.570+0000 7f6217fff640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f620006c8f0 0x7f620006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.570+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f62100ad660 con 0x7f62200cafb0 2024-04-14T10:58:33.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.571+0000 7f6217fff640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f620006c8f0 0x7f620006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f622015abf0 tx=0x7f6208009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.575+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f6220150a60 con 0x7f62200cafb0 2024-04-14T10:58:33.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.750+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6220069b20 con 0x7f62200cafb0 2024-04-14T10:58:33.749 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.751+0000 7f6216ffd640 1 -- 172.21.15.84:0/2744381855 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f621007b560 con 0x7f62200cafb0 2024-04-14T10:58:33.749 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f620006c8f0 msgr2=0x7f620006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f620006c8f0 0x7f620006edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f622015abf0 tx=0x7f6208009040 comp rx=0 tx=0).stop 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 msgr2=0x7f622014a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 0x7f622014a120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f621002ba00 tx=0x7f62100046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 shutdown_connections 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f620006c8f0 0x7f620006edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6220155060 0x7f62201f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62200cc2e0 0x7f62201f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 --2- 172.21.15.84:0/2744381855 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62200cafb0 0x7f622014a120 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.752+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 >> 172.21.15.84:0/2744381855 conn(0x7f6220067720 msgr2=0x7f622014fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.753+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 shutdown_connections 2024-04-14T10:58:33.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.753+0000 7f6224c76640 1 -- 172.21.15.84:0/2744381855 wait complete. 2024-04-14T10:58:33.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:58:33.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.908+0000 7f6102b5e640 1 Processor -- start 2024-04-14T10:58:33.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.908+0000 7f6102b5e640 1 -- start start 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f6102b5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 0x7f60fc1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f6102b5e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60fc073760 con 0x7f60fc0c3660 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f6102b5e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60fc158c40 con 0x7f60fc072a90 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f6102b5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f60fc0739d0 con 0x7f60fc15c230 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f61008fa640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f60fc0c3660 0x7f60fc0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46480/0 (socket says 172.21.15.84:46480) 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f61008fa640 1 -- 172.21.15.84:0/4118311069 learned_addr learned my addr 172.21.15.84:0/4118311069 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f61010fb640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 0x7f60fc1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856960647 0 0) 0x7f60fc073760 con 0x7f60fc0c3660 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60ec003520 con 0x7f60fc0c3660 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1520763566 0 0) 0x7f60ec003520 con 0x7f60fc0c3660 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 msgr2=0x7f60fc1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:33.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 0x7f60fc1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 >> v1:172.21.15.175:6789/0 conn(0x7f60fc072a90 legacy=0x7f60fc1615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 --> v1:172.21.15.84:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc073cb0 con 0x7f60fc0c3660 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 <== mon.0 v1:172.21.15.84:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 175136002 0 0) 0x7f60f0001670 con 0x7f60fc0c3660 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 >> v1:172.21.15.84:6789/0 conn(0x7f60fc0c3660 legacy=0x7f60fc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60ec0039e0 0x7f60ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec004800 0x7f60ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 0x7f60ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc0739d0 con 0x7f60ec0039e0 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec00bb00 con 0x7f60ec004800 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.909+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f60ec00bd00 con 0x7f60fc15c230 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60ec0039e0 0x7f60ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61010fb640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 0x7f60ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f60fbfff640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec004800 0x7f60ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 -- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 msgr2=0x7f60ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:33.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc15c230 0x7f60ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 -- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec004800 msgr2=0x7f60ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec004800 0x7f60ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 -- 172.21.15.84:0/4118311069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec003520 con 0x7f60ec0039e0 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f60fbfff640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec004800 0x7f60ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.910+0000 7f61008fa640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60ec0039e0 0x7f60ec003e00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f60f0001eb0 tx=0x7f60ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fe6009deb048c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0007d30 con 0x7f60ec0039e0 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f0030070 con 0x7f60ec0039e0 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f60fb7fe640 1 -- 172.21.15.84:0/4118311069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0005d30 con 0x7f60ec0039e0 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f6102b5e640 1 -- 172.21.15.84:0/4118311069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60ec0039e0 msgr2=0x7f60ec003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f6102b5e640 1 --2- 172.21.15.84:0/4118311069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60ec0039e0 0x7f60ec003e00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f60f0001eb0 tx=0x7f60ec005830 comp rx=0 tx=0).stop 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f61010fb640 1 -- 172.21.15.84:0/4118311069 reap_dead start 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f6102b5e640 1 -- 172.21.15.84:0/4118311069 shutdown_connections 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f6102b5e640 1 -- 172.21.15.84:0/4118311069 >> 172.21.15.84:0/4118311069 conn(0x7f60fc0c9e70 msgr2=0x7f60fc0ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f6102b5e640 1 -- 172.21.15.84:0/4118311069 shutdown_connections 2024-04-14T10:58:33.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.911+0000 7f6102b5e640 1 -- 172.21.15.84:0/4118311069 wait complete. 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.912+0000 7f6102b5e640 1 Processor -- start 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.912+0000 7f6102b5e640 1 -- start start 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f6102b5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec0039e0 0x7f60fc0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f6102b5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc1f4ae0 0x7f60fc0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f6102b5e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 0x7f60fc14ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f6102b5e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc0c7490 con 0x7f60fc14cee0 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f6102b5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1591a0 con 0x7f60ec0039e0 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f6102b5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f60fc153250 con 0x7f60fc1f4ae0 2024-04-14T10:58:33.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f61010fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 0x7f60fc14ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f61010fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 0x7f60fc14ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53530/0 (socket says 172.21.15.84:53530) 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.913+0000 7f61010fb640 1 -- 172.21.15.84:0/1840472693 learned_addr learned my addr 172.21.15.84:0/1840472693 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f60fbfff640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc1f4ae0 0x7f60fc0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61008fa640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec0039e0 0x7f60fc0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61010fb640 1 -- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc1f4ae0 msgr2=0x7f60fc0c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61010fb640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc1f4ae0 0x7f60fc0c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61010fb640 1 -- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec0039e0 msgr2=0x7f60fc0c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61010fb640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec0039e0 0x7f60fc0c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61010fb640 1 -- 172.21.15.84:0/1840472693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc0c4db0 con 0x7f60fc14cee0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f60fbfff640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc1f4ae0 0x7f60fc0c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61008fa640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec0039e0 0x7f60fc0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f61010fb640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 0x7f60fc14ab90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f60fc072a20 tx=0x7f60f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4015430 con 0x7f60fc14cee0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f401d070 con 0x7f60fc14cee0 2024-04-14T10:58:33.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60fc15a240 con 0x7f60fc14cee0 2024-04-14T10:58:33.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4015830 con 0x7f60fc14cee0 2024-04-14T10:58:33.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.914+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60fc1f4000 con 0x7f60fc14cee0 2024-04-14T10:58:33.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.915+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60fc069b20 con 0x7f60fc14cee0 2024-04-14T10:58:33.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.915+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f60f40159d0 con 0x7f60fc14cee0 2024-04-14T10:58:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.916+0000 7f60f97fa640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f60e006c8f0 0x7f60e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.916+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f60f408c3f0 con 0x7f60fc14cee0 2024-04-14T10:58:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.916+0000 7f61008fa640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f60e006c8f0 0x7f60e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:33.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.916+0000 7f61008fa640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f60e006c8f0 0x7f60e006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60f0034000 tx=0x7f60f0009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:33.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:33.920+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f60f4010040 con 0x7f60fc14cee0 2024-04-14T10:58:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.096+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f60fc0734a0 con 0x7f60fc14cee0 2024-04-14T10:58:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.096+0000 7f60f97fa640 1 -- 172.21.15.84:0/1840472693 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f60f405a820 con 0x7f60fc14cee0 2024-04-14T10:58:34.095 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f60e006c8f0 msgr2=0x7f60e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f60e006c8f0 0x7f60e006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60f0034000 tx=0x7f60f0009030 comp rx=0 tx=0).stop 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 msgr2=0x7f60fc14ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 0x7f60fc14ab90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f60fc072a20 tx=0x7f60f400f580 comp rx=0 tx=0).stop 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 shutdown_connections 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f60e006c8f0 0x7f60e006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f60fc14cee0 0x7f60fc14ab90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60fc1f4ae0 0x7f60fc0c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 --2- 172.21.15.84:0/1840472693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60ec0039e0 0x7f60fc0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 >> 172.21.15.84:0/1840472693 conn(0x7f60fc0c9e70 msgr2=0x7f60fc0c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:34.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 shutdown_connections 2024-04-14T10:58:34.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.098+0000 7f6102b5e640 1 -- 172.21.15.84:0/1840472693 wait complete. 2024-04-14T10:58:34.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 Processor -- start 2024-04-14T10:58:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 -- start start 2024-04-14T10:58:34.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8d415cdf0 0x7fc8d40ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8d415acd0 con 0x7fc8d40ce320 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc8d415af70 con 0x7fc8d415cdf0 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.209+0000 7fc8daede640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d415b210 con 0x7fc8d41551d0 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8d415cdf0 0x7fc8d40ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc8d415cdf0 0x7fc8d40ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53542/0 (socket says 172.21.15.84:53542) 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 -- 172.21.15.84:0/2840390721 learned_addr learned my addr 172.21.15.84:0/2840390721 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d8c7a640 1 --2- 172.21.15.84:0/2840390721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 -- 172.21.15.84:0/2840390721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 msgr2=0x7fc8d406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 --2- 172.21.15.84:0/2840390721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d406faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 -- 172.21.15.84:0/2840390721 >> v1:172.21.15.175:6789/0 conn(0x7fc8d40ce320 legacy=0x7fc8d415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 -- 172.21.15.84:0/2840390721 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d415b4f0 con 0x7fc8d415cdf0 2024-04-14T10:58:34.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.210+0000 7fc8d947b640 1 --2- 172.21.15.84:0/2840390721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40ce720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009e50 tx=0x7fc8cc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0aba07864bdd556 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8d37fe640 1 -- 172.21.15.84:0/2840390721 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc02cb00 con 0x7fc8d415cdf0 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8d37fe640 1 -- 172.21.15.84:0/2840390721 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc02cca0 con 0x7fc8d415cdf0 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8d37fe640 1 -- 172.21.15.84:0/2840390721 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc034610 con 0x7fc8d415cdf0 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 -- 172.21.15.84:0/2840390721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d415cdf0 msgr2=0x7fc8d40ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 --2- 172.21.15.84:0/2840390721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40ce720 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009e50 tx=0x7fc8cc02bf60 comp rx=0 tx=0).stop 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 -- 172.21.15.84:0/2840390721 shutdown_connections 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 --2- 172.21.15.84:0/2840390721 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40ce720 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 --2- 172.21.15.84:0/2840390721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 -- 172.21.15.84:0/2840390721 >> 172.21.15.84:0/2840390721 conn(0x7fc8d406db10 msgr2=0x7fc8d406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 -- 172.21.15.84:0/2840390721 shutdown_connections 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.211+0000 7fc8daede640 1 -- 172.21.15.84:0/2840390721 wait complete. 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.212+0000 7fc8daede640 1 Processor -- start 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.212+0000 7fc8daede640 1 -- start start 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8daede640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 0x7fc8d40c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8daede640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d40cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8daede640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8daede640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415c1c0 con 0x7fc8d40ce320 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8daede640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d415bab0 con 0x7fc8d415cdf0 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8daede640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8d40c8d90 con 0x7fc8d41551d0 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8d8c7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 0x7fc8d40c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8d8c7a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 0x7fc8d40c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53544/0 (socket says 172.21.15.84:53544) 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.213+0000 7fc8d8c7a640 1 -- 172.21.15.84:0/59702 learned_addr learned my addr 172.21.15.84:0/59702 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d3fff640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d40cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d947b640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d8c7a640 1 -- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 msgr2=0x7fc8d40cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d8c7a640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d40cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d8c7a640 1 -- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d415cdf0 msgr2=0x7fc8d40c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d8c7a640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d8c7a640 1 -- 172.21.15.84:0/59702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d406c130 con 0x7fc8d40ce320 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d3fff640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d40cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d8c7a640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 0x7fc8d40c7ee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d800 tx=0x7fc8c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800b6c0 con 0x7fc8d40ce320 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c8019070 con 0x7fc8d40ce320 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800ba80 con 0x7fc8d40ce320 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d41f0a40 con 0x7fc8d40ce320 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.214+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d41f1000 con 0x7fc8d40ce320 2024-04-14T10:58:34.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.215+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d4069c30 con 0x7fc8d40ce320 2024-04-14T10:58:34.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.216+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8c800bc20 con 0x7fc8d40ce320 2024-04-14T10:58:34.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.216+0000 7fc8d17fa640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc8b806c8f0 0x7fc8b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.216+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc8c808c000 con 0x7fc8d40ce320 2024-04-14T10:58:34.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.216+0000 7fc8d3fff640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc8b806c8f0 0x7fc8b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.216+0000 7fc8d3fff640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc8b806c8f0 0x7fc8b806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4159570 tx=0x7fc8c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.220+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc8c8011340 con 0x7fc8d40ce320 2024-04-14T10:58:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.433+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8d406f8b0 con 0x7fc8d40ce320 2024-04-14T10:58:34.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.434+0000 7fc8d17fa640 1 -- 172.21.15.84:0/59702 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7fc8c805a430 con 0x7fc8d40ce320 2024-04-14T10:58:34.433 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:34.433 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T10:58:34.433 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc8b806c8f0 msgr2=0x7fc8b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc8b806c8f0 0x7fc8b806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4159570 tx=0x7fc8c0008040 comp rx=0 tx=0).stop 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 msgr2=0x7fc8d40c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 0x7fc8d40c7ee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d800 tx=0x7fc8c800dcc0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 shutdown_connections 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc8b806c8f0 0x7fc8b806edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d415cdf0 0x7fc8d40c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d41551d0 0x7fc8d40cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 --2- 172.21.15.84:0/59702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8d40ce320 0x7fc8d40c7ee0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 >> 172.21.15.84:0/59702 conn(0x7fc8d406db10 msgr2=0x7fc8d4159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 shutdown_connections 2024-04-14T10:58:34.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.436+0000 7fc8daede640 1 -- 172.21.15.84:0/59702 wait complete. 2024-04-14T10:58:34.446 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:58:34.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.547+0000 7f2b1826d640 1 Processor -- start 2024-04-14T10:58:34.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.547+0000 7f2b1826d640 1 -- start start 2024-04-14T10:58:34.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b1826d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b100738e0 0x7f2b100c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b1826d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b10152f80 con 0x7f2b100c70c0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b1826d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b10073ed0 con 0x7f2b10152ba0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b1826d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f2b1006ca40 con 0x7f2b100738e0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b15808640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f2b100738e0 0x7f2b100c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b1680a640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f2b100c70c0 0x7f2b10158a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46492/0 (socket says 172.21.15.84:46492) 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b1680a640 1 -- 172.21.15.84:0/945965047 learned_addr learned my addr 172.21.15.84:0/945965047 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b15808640 1 -- 172.21.15.84:0/945965047 >> v1:172.21.15.175:6789/0 conn(0x7f2b10152ba0 legacy=0x7f2b1006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.548+0000 7f2b15808640 1 -- 172.21.15.84:0/945965047 >> v1:172.21.15.84:6789/0 conn(0x7f2b100c70c0 legacy=0x7f2b10158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.549+0000 7f2b15007640 1 -- 172.21.15.84:0/945965047 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919815652 0 0) 0x7f2b10152f80 con 0x7f2b100c70c0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.549+0000 7f2b15808640 1 -- 172.21.15.84:0/945965047 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b100c7f10 con 0x7f2b100738e0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.549+0000 7f2b15808640 1 --2- 172.21.15.84:0/945965047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b100738e0 0x7f2b100c6b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b000097a0 tx=0x7f2b0002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a413a30d7a1fbfe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.549+0000 7f2b15007640 1 -- 172.21.15.84:0/945965047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b00034070 con 0x7f2b100738e0 2024-04-14T10:58:34.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.549+0000 7f2b15007640 1 -- 172.21.15.84:0/945965047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b00030610 con 0x7f2b100738e0 2024-04-14T10:58:34.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.549+0000 7f2b15007640 1 -- 172.21.15.84:0/945965047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b000309e0 con 0x7f2b100738e0 2024-04-14T10:58:34.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 -- 172.21.15.84:0/945965047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b100738e0 msgr2=0x7f2b100c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 --2- 172.21.15.84:0/945965047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b100738e0 0x7f2b100c6b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2b000097a0 tx=0x7f2b0002b960 comp rx=0 tx=0).stop 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 -- 172.21.15.84:0/945965047 shutdown_connections 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 --2- 172.21.15.84:0/945965047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b100738e0 0x7f2b100c6b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 -- 172.21.15.84:0/945965047 >> 172.21.15.84:0/945965047 conn(0x7f2b100cdc60 msgr2=0x7f2b100c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 -- 172.21.15.84:0/945965047 shutdown_connections 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.550+0000 7f2b1826d640 1 -- 172.21.15.84:0/945965047 wait complete. 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.551+0000 7f2b1826d640 1 Processor -- start 2024-04-14T10:58:34.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.551+0000 7f2b1826d640 1 -- start start 2024-04-14T10:58:34.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1826d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b100738e0 0x7f2b10158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1826d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b100c70c0 0x7f2b101458e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1826d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 0x7f2b10142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1826d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b1006cc90 con 0x7f2b10152ba0 2024-04-14T10:58:34.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1826d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2b100c84d0 con 0x7f2b100c70c0 2024-04-14T10:58:34.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1826d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1006cf70 con 0x7f2b100738e0 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 0x7f2b10142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 0x7f2b10142c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53566/0 (socket says 172.21.15.84:53566) 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 -- 172.21.15.84:0/3678915107 learned_addr learned my addr 172.21.15.84:0/3678915107 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b16009640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b100738e0 0x7f2b10158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b15808640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b100c70c0 0x7f2b101458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 -- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b100738e0 msgr2=0x7f2b10158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b100738e0 0x7f2b10158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 -- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b100c70c0 msgr2=0x7f2b101458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b100c70c0 0x7f2b101458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 -- 172.21.15.84:0/3678915107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b101461e0 con 0x7f2b10152ba0 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b16009640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b100738e0 0x7f2b10158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b15808640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b100c70c0 0x7f2b101458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.552+0000 7f2b1680a640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 0x7f2b10142c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c450 tx=0x7f2b0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.553+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08018070 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.553+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b08007500 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.553+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b101ee860 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.553+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08004a20 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.553+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b101eee20 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.554+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b10069c30 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.554+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b0801b070 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.554+0000 7f2b06ffd640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2af406c920 0x7f2af406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.555+0000 7f2b16009640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2af406c920 0x7f2af406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.555+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2b0808ae60 con 0x7f2b10152ba0 2024-04-14T10:58:34.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.555+0000 7f2b16009640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2af406c920 0x7f2af406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00c420 tx=0x7f2b0c009570 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.559+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f2b08059200 con 0x7f2b10152ba0 2024-04-14T10:58:34.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.735+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b100736c0 con 0x7f2b10152ba0 2024-04-14T10:58:34.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.736+0000 7f2b06ffd640 1 -- 172.21.15.84:0/3678915107 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16581 (secure 0 0 0) 0x7f2b08058b00 con 0x7f2b10152ba0 2024-04-14T10:58:34.734 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:34.735 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":20,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T10:58:05.194557+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:58:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2af406c920 msgr2=0x7f2af406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2af406c920 0x7f2af406ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00c420 tx=0x7f2b0c009570 comp rx=0 tx=0).stop 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 msgr2=0x7f2b10142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 0x7f2b10142c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c450 tx=0x7f2b0800c910 comp rx=0 tx=0).stop 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 shutdown_connections 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f2af406c920 0x7f2af406ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b10152ba0 0x7f2b10142c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b100c70c0 0x7f2b101458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 --2- 172.21.15.84:0/3678915107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b100738e0 0x7f2b10158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 >> 172.21.15.84:0/3678915107 conn(0x7f2b100cdc60 msgr2=0x7f2b10148210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 shutdown_connections 2024-04-14T10:58:34.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.738+0000 7f2b1826d640 1 -- 172.21.15.84:0/3678915107 wait complete. 2024-04-14T10:58:34.747 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 457606 2024-04-14T10:58:34.748 DEBUG:tasks.quiescer:Yielding 2024-04-14T10:58:34.748 INFO:teuthology.run_tasks:Running task workunit... 2024-04-14T10:58:34.807 INFO:tasks.workunit:Pulling workunits from ref 605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:58:34.808 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-14T10:58:34.808 INFO:tasks.workunit:timeout=6h 2024-04-14T10:58:34.808 INFO:tasks.workunit:cleanup=True 2024-04-14T10:58:34.808 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:34.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:58:34.825 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-14 10:58:09.197348767 +0000 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-14 10:58:29.006367864 +0000 2024-04-14T10:58:34.826 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: - 2024-04-14T10:58:34.826 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-14T10:58:34.826 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-14T10:58:34.898 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 605eb1656ce49fe7fede4f53b18852ac638918c7 2024-04-14T10:58:34.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.914+0000 7f476ec60640 1 Processor -- start 2024-04-14T10:58:34.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.914+0000 7f476ec60640 1 -- start start 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476ec60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4768155160 0x7f47680cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476ec60640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47680b3930 0x7f47680cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476ec60640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f476815afc0 0x7f476815b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476ec60640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f476815b990 con 0x7f476815afc0 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476ec60640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f47680ccd90 con 0x7f47680b3930 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476ec60640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f476815e4d0 con 0x7f4768155160 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f476815afc0 0x7f476815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f476815afc0 0x7f476815b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53582/0 (socket says 172.21.15.84:53582) 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 -- 172.21.15.84:0/2046823212 learned_addr learned my addr 172.21.15.84:0/2046823212 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:34.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f4767fff640 1 --2- 172.21.15.84:0/2046823212 >> v2:172.21.15.175:3300/0 conn(0x7f47680b3930 0x7f47680cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476c9fc640 1 --2- 172.21.15.84:0/2046823212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4768155160 0x7f47680cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 -- 172.21.15.84:0/2046823212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4768155160 msgr2=0x7f47680cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:34.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 --2- 172.21.15.84:0/2046823212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4768155160 0x7f47680cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 -- 172.21.15.84:0/2046823212 >> v2:172.21.15.175:3300/0 conn(0x7f47680b3930 msgr2=0x7f47680cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:34.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 --2- 172.21.15.84:0/2046823212 >> v2:172.21.15.175:3300/0 conn(0x7f47680b3930 0x7f47680cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f476d1fd640 1 -- 172.21.15.84:0/2046823212 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476815e7b0 con 0x7f476815afc0 2024-04-14T10:58:34.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.915+0000 7f4767fff640 1 --2- 172.21.15.84:0/2046823212 >> v2:172.21.15.175:3300/0 conn(0x7f47680b3930 0x7f47680cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.916+0000 7f476d1fd640 1 --2- 172.21.15.84:0/2046823212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f476815afc0 0x7f476815b450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f476808ded0 tx=0x7f476002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcc422eceed0301 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.916+0000 7f47677fe640 1 -- 172.21.15.84:0/2046823212 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476002cb00 con 0x7f476815afc0 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.916+0000 7f47677fe640 1 -- 172.21.15.84:0/2046823212 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476002cca0 con 0x7f476815afc0 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.916+0000 7f47677fe640 1 -- 172.21.15.84:0/2046823212 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760034610 con 0x7f476815afc0 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 -- 172.21.15.84:0/2046823212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f476815afc0 msgr2=0x7f476815b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 --2- 172.21.15.84:0/2046823212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f476815afc0 0x7f476815b450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f476808ded0 tx=0x7f476002bf60 comp rx=0 tx=0).stop 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 -- 172.21.15.84:0/2046823212 shutdown_connections 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 --2- 172.21.15.84:0/2046823212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f476815afc0 0x7f476815b450 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 --2- 172.21.15.84:0/2046823212 >> v2:172.21.15.175:3300/0 conn(0x7f47680b3930 0x7f47680cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 --2- 172.21.15.84:0/2046823212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4768155160 0x7f47680cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 -- 172.21.15.84:0/2046823212 >> 172.21.15.84:0/2046823212 conn(0x7f476806b900 msgr2=0x7f476806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 -- 172.21.15.84:0/2046823212 shutdown_connections 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.917+0000 7f476ec60640 1 -- 172.21.15.84:0/2046823212 wait complete. 2024-04-14T10:58:34.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.918+0000 7f476ec60640 1 Processor -- start 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.918+0000 7f476ec60640 1 -- start start 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476ec60640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 0x7f4768151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476ec60640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4768155160 0x7f476815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476ec60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f476815afc0 0x7f476814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476ec60640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f476815f050 con 0x7f47680b3930 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476ec60640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f476815ed70 con 0x7f4768155160 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476ec60640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4768155540 con 0x7f476815afc0 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 0x7f4768151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 0x7f4768151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53594/0 (socket says 172.21.15.84:53594) 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 -- 172.21.15.84:0/296630769 learned_addr learned my addr 172.21.15.84:0/296630769 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476d1fd640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f476815afc0 0x7f476814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f4767fff640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4768155160 0x7f476815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 -- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f476815afc0 msgr2=0x7f476814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f476815afc0 0x7f476814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 -- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4768155160 msgr2=0x7f476815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4768155160 0x7f476815d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.919+0000 7f476c9fc640 1 -- 172.21.15.84:0/296630769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47680c9630 con 0x7f47680b3930 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.920+0000 7f476c9fc640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 0x7f4768151160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f475c00e9b0 tx=0x7f475c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.920+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c017070 con 0x7f47680b3930 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.920+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475c00c9a0 con 0x7f47680b3930 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.920+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476814f540 con 0x7f47680b3930 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.920+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c00cd90 con 0x7f47680b3930 2024-04-14T10:58:34.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.920+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4768154820 con 0x7f47680b3930 2024-04-14T10:58:34.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.921+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4768069c30 con 0x7f47680b3930 2024-04-14T10:58:34.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.921+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f475c01a070 con 0x7f47680b3930 2024-04-14T10:58:34.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.922+0000 7f47657fa640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f474c06c8f0 0x7f474c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:34.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.922+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f475c08bda0 con 0x7f47680b3930 2024-04-14T10:58:34.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.922+0000 7f4767fff640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f474c06c8f0 0x7f474c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:34.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.922+0000 7f4767fff640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f474c06c8f0 0x7f474c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f476815a230 tx=0x7f4754008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:34.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:34.927+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f475c059c10 con 0x7f47680b3930 2024-04-14T10:58:34.928 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-14T10:58:35.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.152+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47680cbf30 con 0x7f47680b3930 2024-04-14T10:58:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.152+0000 7f47657fa640 1 -- 172.21.15.84:0/296630769 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7f475c05df10 con 0x7f47680b3930 2024-04-14T10:58:35.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T10:58:35.151 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T10:58:35.151 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T10:58:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.154+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f474c06c8f0 msgr2=0x7f474c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.154+0000 7f476ec60640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f474c06c8f0 0x7f474c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f476815a230 tx=0x7f4754008040 comp rx=0 tx=0).stop 2024-04-14T10:58:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.154+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 msgr2=0x7f4768151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.154+0000 7f476ec60640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 0x7f4768151160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f475c00e9b0 tx=0x7f475c00ee70 comp rx=0 tx=0).stop 2024-04-14T10:58:35.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 shutdown_connections 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f474c06c8f0 0x7f474c06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f476815afc0 0x7f476814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4768155160 0x7f476815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 --2- 172.21.15.84:0/296630769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47680b3930 0x7f4768151160 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 >> 172.21.15.84:0/296630769 conn(0x7f476806b900 msgr2=0x7f4768159650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 shutdown_connections 2024-04-14T10:58:35.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.155+0000 7f476ec60640 1 -- 172.21.15.84:0/296630769 wait complete. 2024-04-14T10:58:35.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T10:58:03.536145+0000', 'modified': '2024-04-14T10:58:21.259734+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4308, 'mds_1': 4303, 'mds_2': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.175:6834/903884939', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6832', 'nonce': 903884939}, {'type': 'v1', 'addr': '172.21.15.175:6834', 'nonce': 903884939}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4303': {'gid': 4303, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.175:6837/442498992', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 442498992}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 442498992}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4308': {'gid': 4308, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.175:6835/3381016657', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6833', 'nonce': 3381016657}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 3381016657}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4308, 'qdb_cluster': [4297, 4303, 4308]} 2024-04-14T10:58:35.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-14T10:58:35.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-14T10:58:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.873+0000 7fd49eb5e640 1 Processor -- start 2024-04-14T10:58:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.873+0000 7fd49eb5e640 1 -- start start 2024-04-14T10:58:35.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd49eb5e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4981550d0 0x7fd49806f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd49eb5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 0x7fd4980ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd49eb5e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4981554b0 con 0x7fd4980ce820 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd49eb5e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd49815ae50 con 0x7fd4981550d0 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd49eb5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd49815e340 con 0x7fd49806fdc0 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd48ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 0x7fd4980ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd49c8fa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4981550d0 0x7fd49806f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd48ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 0x7fd4980ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:59710/0 (socket says 172.21.15.84:59710) 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.874+0000 7fd48ffff640 1 -- 172.21.15.84:0/18632002 learned_addr learned my addr 172.21.15.84:0/18632002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.875+0000 7fd48ffff640 1 -- 172.21.15.84:0/18632002 >> v2:172.21.15.175:3300/0 conn(0x7fd4981550d0 msgr2=0x7fd49806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.875+0000 7fd48ffff640 1 --2- 172.21.15.84:0/18632002 >> v2:172.21.15.175:3300/0 conn(0x7fd4981550d0 0x7fd49806f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.875+0000 7fd48ffff640 1 -- 172.21.15.84:0/18632002 >> v1:172.21.15.175:6789/0 conn(0x7fd4980ce820 legacy=0x7fd49815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.875+0000 7fd48ffff640 1 -- 172.21.15.84:0/18632002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49815e600 con 0x7fd49806fdc0 2024-04-14T10:58:35.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.875+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/18632002 >> v2:172.21.15.175:3300/0 conn(0x7fd4981550d0 0x7fd49806f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.875+0000 7fd48ffff640 1 --2- 172.21.15.84:0/18632002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 0x7fd4980ce2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd488009870 tx=0x7fd48802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d795abb7eb6079 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd48f7fe640 1 -- 172.21.15.84:0/18632002 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48802f840 con 0x7fd49806fdc0 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd48f7fe640 1 -- 172.21.15.84:0/18632002 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd48802f9e0 con 0x7fd49806fdc0 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd48f7fe640 1 -- 172.21.15.84:0/18632002 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48802fdb0 con 0x7fd49806fdc0 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 -- 172.21.15.84:0/18632002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 msgr2=0x7fd4980ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/18632002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 0x7fd4980ce2e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd488009870 tx=0x7fd48802ba20 comp rx=0 tx=0).stop 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 -- 172.21.15.84:0/18632002 shutdown_connections 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/18632002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd49806fdc0 0x7fd4980ce2e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/18632002 >> v2:172.21.15.175:3300/0 conn(0x7fd4981550d0 0x7fd49806f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 -- 172.21.15.84:0/18632002 >> 172.21.15.84:0/18632002 conn(0x7fd498067d50 msgr2=0x7fd49806db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 -- 172.21.15.84:0/18632002 shutdown_connections 2024-04-14T10:58:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.876+0000 7fd49eb5e640 1 -- 172.21.15.84:0/18632002 wait complete. 2024-04-14T10:58:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.877+0000 7fd49eb5e640 1 Processor -- start 2024-04-14T10:58:35.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.877+0000 7fd49eb5e640 1 -- start start 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49eb5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49806fdc0 0x7fd4980cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49eb5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4980ce820 0x7fd498159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49eb5e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 0x7fd49815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49eb5e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815eea0 con 0x7fd4981550d0 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49eb5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd49815ebc0 con 0x7fd49806fdc0 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49eb5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd49815f180 con 0x7fd4980ce820 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 0x7fd49815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 0x7fd49815a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53604/0 (socket says 172.21.15.84:53604) 2024-04-14T10:58:35.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2258034637 learned_addr learned my addr 172.21.15.84:0/2258034637 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49806fdc0 0x7fd4980cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.878+0000 7fd48ffff640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4980ce820 0x7fd498159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4980ce820 msgr2=0x7fd498159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4980ce820 0x7fd498159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49806fdc0 msgr2=0x7fd4980cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49806fdc0 0x7fd4980cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2258034637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd498154780 con 0x7fd4981550d0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 0x7fd49815a2d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c7a0 tx=0x7fd49000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd48d7fa640 1 -- 172.21.15.84:0/2258034637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490003b70 con 0x7fd4981550d0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd48d7fa640 1 -- 172.21.15.84:0/2258034637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd490003d30 con 0x7fd4981550d0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49815dd70 con 0x7fd4981550d0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd48d7fa640 1 -- 172.21.15.84:0/2258034637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49000aa90 con 0x7fd4981550d0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.879+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49815cfa0 con 0x7fd4981550d0 2024-04-14T10:58:35.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.880+0000 7fd48d7fa640 1 -- 172.21.15.84:0/2258034637 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd49000ac30 con 0x7fd4981550d0 2024-04-14T10:58:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.881+0000 7fd48d7fa640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd48406c8f0 0x7fd48406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.881+0000 7fd48d7fa640 1 -- 172.21.15.84:0/2258034637 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd49008b960 con 0x7fd4981550d0 2024-04-14T10:58:35.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.881+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd48406c8f0 0x7fd48406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.881+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd48406c8f0 0x7fd48406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd494009560 tx=0x7fd494009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 Processor -- start 2024-04-14T10:58:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 -- start start 2024-04-14T10:58:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e403bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e404100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 0x56456e443040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56456e368990 con 0x56456e402240 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56456e30f620 con 0x56456e4037e0 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.882+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56456e364950 con 0x56456e44d660 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 0x56456e443040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 0x56456e443040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53620/0 (socket says 172.21.15.84:53620) 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2696544932 learned_addr learned my addr 172.21.15.84:0/2696544932 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd48ffff640 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e404100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e403bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 msgr2=0x56456e404100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e404100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 msgr2=0x56456e403bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e403bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 -- 172.21.15.84:0/2696544932 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456e07b2d0 con 0x56456e402240 2024-04-14T10:58:35.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 0x56456e443040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd4900013b0 tx=0x7fd490011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fd2eca2a21e0b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd47e7fc640 1 -- 172.21.15.84:0/2696544932 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49005da40 con 0x56456e402240 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd47e7fc640 1 -- 172.21.15.84:0/2696544932 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd490062270 con 0x56456e402240 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.883+0000 7fd47e7fc640 1 -- 172.21.15.84:0/2696544932 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490057a40 con 0x56456e402240 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 -- 172.21.15.84:0/2696544932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 msgr2=0x56456e443040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 0x56456e443040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd4900013b0 tx=0x7fd490011000 comp rx=0 tx=0).stop 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 -- 172.21.15.84:0/2696544932 shutdown_connections 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e402240 0x56456e443040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e404100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/2696544932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e403bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 -- 172.21.15.84:0/2696544932 >> 172.21.15.84:0/2696544932 conn(0x56456e3fff50 msgr2=0x56456e402890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 -- 172.21.15.84:0/2696544932 shutdown_connections 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 -- 172.21.15.84:0/2696544932 wait complete. 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 -- start start 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.884+0000 7fd4a1a28740 1 Processor -- start 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 0x56456e43fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44d660 0x56456e44df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e429aa0 0x56456e4280b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56456e428d40 con 0x56456e4037e0 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56456e3229e0 con 0x56456e44d660 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56456e401100 con 0x56456e429aa0 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd4a1a28740 10 client.0 _ll_register_callbacks cb 0x56456e35e220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd49c8fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 0x56456e43fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd49c8fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 0x56456e43fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53624/0 (socket says 172.21.15.84:53624) 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd49c8fa640 1 -- 172.21.15.84:0/3390381592 learned_addr learned my addr 172.21.15.84:0/3390381592 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e429aa0 0x56456e4280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.885+0000 7fd48ffff640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44d660 0x56456e44df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd49c8fa640 1 -- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e429aa0 msgr2=0x56456e4280b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e429aa0 0x56456e4280b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd49c8fa640 1 -- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44d660 msgr2=0x56456e44df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44d660 0x56456e44df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd49c8fa640 1 -- 172.21.15.84:0/3390381592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456e1456b0 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 0x56456e43fa40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd494011fb0 tx=0x7fd4940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a25eb0c1a05d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4777fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4777fe640 1 -- 172.21.15.84:0/3390381592 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494026070 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4777fe640 1 -- 172.21.15.84:0/3390381592 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd494014440 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd490062270 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4777fe640 1 -- 172.21.15.84:0/3390381592 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fd494031050 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 10 client.4926 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56456e441830 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4777fe640 1 -- 172.21.15.84:0/3390381592 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd490062270 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4777fe640 1 -- 172.21.15.84:0/3390381592 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fd494034020 con 0x56456e4037e0 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 10 client.4926 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:35.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 10 client.4926 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 20 client.4926 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e457bd0 0x56456e4634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 4 client.4926 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.886+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 --> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56456e3763b0 con 0x56456e457bd0 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.887+0000 7fd48ffff640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e457bd0 0x56456e4634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.887+0000 7fd48ffff640 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e457bd0 0x56456e4634b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1921f22fa2beed4f server_cookie=36484ca0b01d4485 in_seq=0 out_seq=0 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.887+0000 7fd4777fe640 10 client.4926 ms_handle_connect on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4777fe640 1 -- 172.21.15.84:0/3390381592 <== mds.2 v2:172.21.15.175:6832/903884939 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56456e3763b0 con 0x56456e457bd0 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4777fe640 10 client.4926 handle_command_reply: tid=0 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 client.4926 shutdown 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 msgr2=0x56456e43fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 0x56456e43fa40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd494011fb0 tx=0x7fd4940046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 shutdown_connections 2024-04-14T10:58:35.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e457bd0 0x56456e4634b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e429aa0 0x56456e4280b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44d660 0x56456e44df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/3390381592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e4037e0 0x56456e43fa40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4777fe640 0 client.4926 ms_handle_reset on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 >> 172.21.15.84:0/3390381592 conn(0x56456e402240 msgr2=0x56456e444a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 shutdown_connections 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 1 -- 172.21.15.84:0/3390381592 wait complete. 2024-04-14T10:58:35.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.888+0000 7fd4a1a28740 20 client.4926 trim_cache size 0 max 16384 2024-04-14T10:58:35.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.906+0000 7fd4a1a28740 1 Processor -- start 2024-04-14T10:58:35.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.906+0000 7fd4a1a28740 1 -- start start 2024-04-14T10:58:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e402a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e440450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 0x56456e440990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4981f4500 con 0x56456e44c970 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56456e428ac0 con 0x56456e4037e0 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56456e44e470 con 0x56456e44d660 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 0x56456e440990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 0x56456e440990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53628/0 (socket says 172.21.15.84:53628) 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 -- 172.21.15.84:0/944767310 learned_addr learned my addr 172.21.15.84:0/944767310 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 -- 172.21.15.84:0/944767310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 msgr2=0x56456e440450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e440450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 -- 172.21.15.84:0/944767310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 msgr2=0x56456e402a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e402a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 -- 172.21.15.84:0/944767310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456e42d110 con 0x56456e44c970 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 0x56456e440990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd490055ba0 tx=0x7fd49001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3d205d253ba49c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd47dffb640 1 -- 172.21.15.84:0/944767310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd490062270 con 0x56456e44c970 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd47dffb640 1 -- 172.21.15.84:0/944767310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd490076070 con 0x56456e44c970 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.907+0000 7fd47dffb640 1 -- 172.21.15.84:0/944767310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49005da40 con 0x56456e44c970 2024-04-14T10:58:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 -- 172.21.15.84:0/944767310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 msgr2=0x56456e440990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 0x56456e440990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd490055ba0 tx=0x7fd49001c000 comp rx=0 tx=0).stop 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 -- 172.21.15.84:0/944767310 shutdown_connections 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44c970 0x56456e440990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e44d660 0x56456e440450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/944767310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e4037e0 0x56456e402a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 -- 172.21.15.84:0/944767310 >> 172.21.15.84:0/944767310 conn(0x56456e402240 msgr2=0x56456e4017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 -- 172.21.15.84:0/944767310 shutdown_connections 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 -- 172.21.15.84:0/944767310 wait complete. 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.908+0000 7fd4a1a28740 1 -- start start 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 Processor -- start 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e4037e0 0x56456e443c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44c970 0x56456e403fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 0x56456e4bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56456e457a50 con 0x56456e44d660 2024-04-14T10:58:35.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56456e42c5c0 con 0x56456e44c970 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56456e458120 con 0x56456e4037e0 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd4a1a28740 10 client.0 _ll_register_callbacks cb 0x7fd494011c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.909+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 0x56456e4bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 0x56456e4bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53632/0 (socket says 172.21.15.84:53632) 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 -- 172.21.15.84:0/200597155 learned_addr learned my addr 172.21.15.84:0/200597155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e4037e0 0x56456e443c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd48ffff640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44c970 0x56456e403fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 -- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e4037e0 msgr2=0x56456e443c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e4037e0 0x56456e443c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 -- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44c970 msgr2=0x56456e403fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44c970 0x56456e403fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 -- 172.21.15.84:0/200597155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456e445060 con 0x56456e44d660 2024-04-14T10:58:35.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd48ffff640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44c970 0x56456e403fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd49d0fb640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 0x56456e4bf830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd490061d40 tx=0x7fd490001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a52e64007fec07 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4777fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4777fe640 1 -- 172.21.15.84:0/200597155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49007e060 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4777fe640 1 -- 172.21.15.84:0/200597155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd490057a40 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd490076070 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4777fe640 1 -- 172.21.15.84:0/200597155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fd49005da40 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4a1a28740 10 client.4932 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56456e3fed30 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4777fe640 1 -- 172.21.15.84:0/200597155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd490076070 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4777fe640 1 -- 172.21.15.84:0/200597155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fd490055db0 con 0x56456e44d660 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.910+0000 7fd4a1a28740 10 client.4932 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 10 client.4932 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 20 client.4932 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e4c25c0 0x56456e4c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 4 client.4932 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 --> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] -- command(tid 0: {"prefix": "status"}) -- 0x56456e370220 con 0x56456e4c25c0 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e4c25c0 0x56456e4c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4777fe640 10 client.4932 ms_handle_connect on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd49c8fa640 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e4c25c0 0x56456e4c29a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ced3db52327bc058 server_cookie=c797eb6fef67bb99 in_seq=0 out_seq=0 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4777fe640 1 -- 172.21.15.84:0/200597155 <== mds.2 v2:172.21.15.175:6832/903884939 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56456e370220 con 0x56456e4c25c0 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4777fe640 10 client.4932 handle_command_reply: tid=0 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 client.4932 shutdown 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 msgr2=0x56456e4bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 0x56456e4bf830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd490061d40 tx=0x7fd490001250 comp rx=0 tx=0).stop 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 shutdown_connections 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:6832/903884939,v1:172.21.15.175:6834/903884939] conn(0x56456e4c25c0 0x56456e4c29a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56456e44d660 0x56456e4bf830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56456e44c970 0x56456e403fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4777fe640 0 client.4932 ms_handle_reset on v2:172.21.15.175:6832/903884939 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 --2- 172.21.15.84:0/200597155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56456e4037e0 0x56456e443c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.911+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 >> 172.21.15.84:0/200597155 conn(0x56456e402240 msgr2=0x56456e43f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 shutdown_connections 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd4a1a28740 1 -- 172.21.15.84:0/200597155 wait complete. 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd4a1a28740 20 client.4932 trim_cache size 0 max 16384 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "8f4fd445-3fea-4722-8345-0096c2ce143b", 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-04-14T10:58:35.917 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4297, 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 20.665066930999998, 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 13, 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 20, 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 20, 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 38.882411967000003 2024-04-14T10:58:35.918 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd48406c8f0 msgr2=0x7fd48406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd48406c8f0 0x7fd48406edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd494009560 tx=0x7fd494009190 comp rx=0 tx=0).stop 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 msgr2=0x7fd49815a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 0x7fd49815a2d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c7a0 tx=0x7fd49000cc60 comp rx=0 tx=0).stop 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 shutdown_connections 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fd48406c8f0 0x7fd48406edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4981550d0 0x7fd49815a2d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4980ce820 0x7fd498159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 --2- 172.21.15.84:0/2258034637 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd49806fdc0 0x7fd4980cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 >> 172.21.15.84:0/2258034637 conn(0x7fd498067d50 msgr2=0x7fd4980c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 shutdown_connections 2024-04-14T10:58:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:35.912+0000 7fd49eb5e640 1 -- 172.21.15.84:0/2258034637 wait complete. 2024-04-14T10:58:35.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-14T10:58:36.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.023+0000 7f526c42d640 1 Processor -- start 2024-04-14T10:58:36.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.023+0000 7f526c42d640 1 -- start start 2024-04-14T10:58:36.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526c42d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f526406b900 0x7f5264164470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526c42d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5264071260 con 0x7f5264152fc0 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526c42d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5264070ca0 con 0x7f526406fff0 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526c42d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f5264070f80 con 0x7f526406b900 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526a9ca640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f526406b900 0x7f5264164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526a9ca640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f526406b900 0x7f5264164470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53644/0 (socket says 172.21.15.84:53644) 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526a9ca640 1 -- 172.21.15.84:0/494115781 learned_addr learned my addr 172.21.15.84:0/494115781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.024+0000 7f526a1c9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5264152fc0 0x7f52640c6b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46504/0 (socket says 172.21.15.84:46504) 2024-04-14T10:58:36.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.025+0000 7f526a9ca640 1 -- 172.21.15.84:0/494115781 >> v1:172.21.15.175:6789/0 conn(0x7f526406fff0 legacy=0x7f526415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.025+0000 7f526a9ca640 1 -- 172.21.15.84:0/494115781 >> v1:172.21.15.84:6789/0 conn(0x7f5264152fc0 legacy=0x7f52640c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.025+0000 7f526a9ca640 1 -- 172.21.15.84:0/494115781 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52640c7f80 con 0x7f526406b900 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.025+0000 7f526a9ca640 1 --2- 172.21.15.84:0/494115781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f526406b900 0x7f5264164470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f525c009870 tx=0x7f525c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6636f153a962346 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.025+0000 7f52691c7640 1 -- 172.21.15.84:0/494115781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c035020 con 0x7f526406b900 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f52691c7640 1 -- 172.21.15.84:0/494115781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c031870 con 0x7f526406b900 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f52691c7640 1 -- 172.21.15.84:0/494115781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c031c40 con 0x7f526406b900 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 -- 172.21.15.84:0/494115781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f526406b900 msgr2=0x7f5264164470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 --2- 172.21.15.84:0/494115781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f526406b900 0x7f5264164470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f525c009870 tx=0x7f525c02b910 comp rx=0 tx=0).stop 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 -- 172.21.15.84:0/494115781 shutdown_connections 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 --2- 172.21.15.84:0/494115781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f526406b900 0x7f5264164470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 -- 172.21.15.84:0/494115781 >> 172.21.15.84:0/494115781 conn(0x7f52640c9f70 msgr2=0x7f52640ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 -- 172.21.15.84:0/494115781 shutdown_connections 2024-04-14T10:58:36.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.026+0000 7f526c42d640 1 -- 172.21.15.84:0/494115781 wait complete. 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.027+0000 7f526c42d640 1 Processor -- start 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.027+0000 7f526c42d640 1 -- start start 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526c42d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f526406b900 0x7f526415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526c42d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526406fff0 0x7f5264151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526c42d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 0x7f52641515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526c42d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52640c8540 con 0x7f5264152fc0 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526c42d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52640739f0 con 0x7f526406b900 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526c42d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f52640c86c0 con 0x7f526406fff0 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 0x7f52641515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 0x7f52641515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53650/0 (socket says 172.21.15.84:53650) 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 -- 172.21.15.84:0/1224228135 learned_addr learned my addr 172.21.15.84:0/1224228135 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f52699c8640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526406fff0 0x7f5264151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f526406b900 0x7f526415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 -- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526406fff0 msgr2=0x7f5264151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526406fff0 0x7f5264151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 -- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f526406b900 msgr2=0x7f526415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f526406b900 0x7f526415b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a9ca640 1 -- 172.21.15.84:0/1224228135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52640c5770 con 0x7f5264152fc0 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f52699c8640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526406fff0 0x7f5264151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.028+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f526406b900 0x7f526415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.029+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 0x7f52641515b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f525c02b950 tx=0x7f525c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.029+0000 7f5262ffd640 1 -- 172.21.15.84:0/1224228135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c040070 con 0x7f5264152fc0 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.029+0000 7f5262ffd640 1 -- 172.21.15.84:0/1224228135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c03a420 con 0x7f5264152fc0 2024-04-14T10:58:36.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.029+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52640c5a50 con 0x7f5264152fc0 2024-04-14T10:58:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.029+0000 7f5262ffd640 1 -- 172.21.15.84:0/1224228135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c035040 con 0x7f5264152fc0 2024-04-14T10:58:36.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.029+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52640c6820 con 0x7f5264152fc0 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.030+0000 7f5262ffd640 1 -- 172.21.15.84:0/1224228135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f525c04b060 con 0x7f5264152fc0 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.030+0000 7f5262ffd640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f525006c920 0x7f525006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.031+0000 7f5262ffd640 1 -- 172.21.15.84:0/1224228135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f525c0ada50 con 0x7f5264152fc0 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.031+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f525006c920 0x7f525006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.031+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f525006c920 0x7f525006ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5254007fd0 tx=0x7f5254009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.032+0000 7f526f210740 1 Processor -- start 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.032+0000 7f526f210740 1 -- start start 2024-04-14T10:58:36.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e6c0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526f210740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 0x55aa1e6ff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526f210740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55aa1e624990 con 0x55aa1e6be240 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aa1e5cb620 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55aa1e620950 con 0x55aa1e709660 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 0x55aa1e6ff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 0x55aa1e6ff040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53652/0 (socket says 172.21.15.84:53652) 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 -- 172.21.15.84:0/2105491589 learned_addr learned my addr 172.21.15.84:0/2105491589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f52699c8640 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e6c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a1c9640 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 -- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 msgr2=0x55aa1e6c0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e6c0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 -- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6bf7e0 msgr2=0x55aa1e6bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 -- 172.21.15.84:0/2105491589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1e3372d0 con 0x55aa1e6be240 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f526a9ca640 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 0x55aa1e6ff040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f525c083e30 tx=0x7f525c009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ebfeb40f8fff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f524bfff640 1 -- 172.21.15.84:0/2105491589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c07b780 con 0x55aa1e6be240 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f524bfff640 1 -- 172.21.15.84:0/2105491589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c07fb30 con 0x55aa1e6be240 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.033+0000 7f524bfff640 1 -- 172.21.15.84:0/2105491589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c084360 con 0x55aa1e6be240 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 -- 172.21.15.84:0/2105491589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 msgr2=0x55aa1e6ff040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 0x55aa1e6ff040 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f525c083e30 tx=0x7f525c009550 comp rx=0 tx=0).stop 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 -- 172.21.15.84:0/2105491589 shutdown_connections 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6be240 0x55aa1e6ff040 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e6c0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 --2- 172.21.15.84:0/2105491589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 -- 172.21.15.84:0/2105491589 >> 172.21.15.84:0/2105491589 conn(0x55aa1e6bbf50 msgr2=0x55aa1e6be890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 -- 172.21.15.84:0/2105491589 shutdown_connections 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.034+0000 7f526f210740 1 -- 172.21.15.84:0/2105491589 wait complete. 2024-04-14T10:58:36.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.035+0000 7f526f210740 1 -- start start 2024-04-14T10:58:36.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.035+0000 7f526f210740 1 Processor -- start 2024-04-14T10:58:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e711840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6fab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55aa1e6e4d40 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aa1e5de9e0 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55aa1e6bd100 con 0x55aa1e709660 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 10 client.0 _ll_register_callbacks cb 0x55aa1e61a220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6e52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53658/0 (socket says 172.21.15.84:53658) 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 -- 172.21.15.84:0/469142531 learned_addr learned my addr 172.21.15.84:0/469142531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f52699c8640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e711840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a9ca640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 -- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 msgr2=0x55aa1e711840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e711840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 -- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6fd6a0 msgr2=0x55aa1e6fab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6fab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 -- 172.21.15.84:0/469142531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa1e4016b0 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526a1c9640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6e52e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f52540073b0 tx=0x7f5254001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d1451bc2ddb664 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f52497fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f52497fa640 1 -- 172.21.15.84:0/469142531 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254026060 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f52497fa640 1 -- 172.21.15.84:0/469142531 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5254007870 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525c07fb30 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.036+0000 7f52497fa640 1 -- 172.21.15.84:0/469142531 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f525402c050 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 10 client.4947 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55aa1e711d80 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f52497fa640 1 -- 172.21.15.84:0/469142531 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c07fb30 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f52497fa640 1 -- 172.21.15.84:0/469142531 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f525402f020 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 10 client.4947 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 10 client.4947 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 20 client.4947 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:36.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e71d660 0x55aa1e71fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 4 client.4947 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 --> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa1e6323b0 con 0x55aa1e71d660 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f52699c8640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e71d660 0x55aa1e71fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f52497fa640 10 client.4947 ms_handle_connect on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.037+0000 7f52699c8640 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e71d660 0x55aa1e71fa50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2218893a697b90b server_cookie=861e4fc7c7987b48 in_seq=0 out_seq=0 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f52497fa640 1 -- 172.21.15.84:0/469142531 <== mds.1 v2:172.21.15.175:6836/442498992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aa1e6323b0 con 0x55aa1e71d660 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f52497fa640 10 client.4947 handle_command_reply: tid=0 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 client.4947 shutdown 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 msgr2=0x55aa1e6e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6e52e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f52540073b0 tx=0x7f5254001250 comp rx=0 tx=0).stop 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 shutdown_connections 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e71d660 0x55aa1e71fa50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e709660 0x55aa1e711840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f52497fa640 0 client.4947 ms_handle_reset on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 --2- 172.21.15.84:0/469142531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6bf7e0 0x55aa1e6e52e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 >> 172.21.15.84:0/469142531 conn(0x55aa1e6be240 msgr2=0x55aa1e700a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 shutdown_connections 2024-04-14T10:58:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.038+0000 7f526f210740 1 -- 172.21.15.84:0/469142531 wait complete. 2024-04-14T10:58:36.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.039+0000 7f526f210740 20 client.4947 trim_cache size 0 max 16384 2024-04-14T10:58:36.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.056+0000 7f526f210740 1 Processor -- start 2024-04-14T10:58:36.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.056+0000 7f526f210740 1 -- start start 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e6c0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e6e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526f210740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6e80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526f210740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f52641f1390 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52641f4620 con 0x55aa1e6be240 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55aa1e6fb940 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6e80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6e80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53668/0 (socket says 172.21.15.84:53668) 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 -- 172.21.15.84:0/1054844977 learned_addr learned my addr 172.21.15.84:0/1054844977 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e6c0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f52699c8640 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e6e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 -- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 msgr2=0x55aa1e6e7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e6e7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 -- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 msgr2=0x55aa1e6c0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e6c0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.057+0000 7f526a9ca640 1 -- 172.21.15.84:0/1054844977 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa1e709490 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6e80d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f525c0abfd0 tx=0x7f525c045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea228c8d5c1135d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f524b7fe640 1 -- 172.21.15.84:0/1054844977 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c077a20 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f524b7fe640 1 -- 172.21.15.84:0/1054844977 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c084360 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f524b7fe640 1 -- 172.21.15.84:0/1054844977 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c07b780 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 -- 172.21.15.84:0/1054844977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 msgr2=0x55aa1e6e80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6e80d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f525c0abfd0 tx=0x7f525c045000 comp rx=0 tx=0).stop 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 -- 172.21.15.84:0/1054844977 shutdown_connections 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e6e80d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e6e7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 --2- 172.21.15.84:0/1054844977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e6c0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 -- 172.21.15.84:0/1054844977 >> 172.21.15.84:0/1054844977 conn(0x55aa1e6e8f50 msgr2=0x55aa1e707980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 -- 172.21.15.84:0/1054844977 shutdown_connections 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.058+0000 7f526f210740 1 -- 172.21.15.84:0/1054844977 wait complete. 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.059+0000 7f526f210740 1 -- start start 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.059+0000 7f526f210740 1 Processor -- start 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e724780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e7110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e7754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55aa1e713d80 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55aa1e6fb080 con 0x55aa1e6be240 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55aa1e7143f0 con 0x55aa1e6bf7e0 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526f210740 10 client.0 _ll_register_callbacks cb 0x7f5254005c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e7754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e7754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53670/0 (socket says 172.21.15.84:53670) 2024-04-14T10:58:36.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 -- 172.21.15.84:0/1909173579 learned_addr learned my addr 172.21.15.84:0/1909173579 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f52699c8640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e7110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e724780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 -- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 msgr2=0x55aa1e7110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e7110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 -- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 msgr2=0x55aa1e724780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e724780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 -- 172.21.15.84:0/1909173579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa1e6fd200 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f526a9ca640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e7754a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f525c009870 tx=0x7f525c03c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf4fc6767fdbff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f52497fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.060+0000 7f52497fa640 1 -- 172.21.15.84:0/1909173579 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c07b780 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f52497fa640 1 -- 172.21.15.84:0/1909173579 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f525c031730 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525c084360 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f52497fa640 1 -- 172.21.15.84:0/1909173579 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f525c083ed0 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 10 client.4953 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55aa1e6fd200 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f52497fa640 1 -- 172.21.15.84:0/1909173579 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c084360 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f52497fa640 1 -- 172.21.15.84:0/1909173579 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f525c07abd0 con 0x55aa1e6fd6a0 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 10 client.4953 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 10 client.4953 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 20 client.4953 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e709660 0x55aa1e703530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 4 client.4953 mds_command: new command op to 4303 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 --> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] -- command(tid 0: {"prefix": "status"}) -- 0x55aa1e62c220 con 0x55aa1e709660 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.061+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e709660 0x55aa1e703530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f52497fa640 10 client.4953 ms_handle_connect on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526a1c9640 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e709660 0x55aa1e703530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a8dc9b91b385424 server_cookie=5cc2375b327938b2 in_seq=0 out_seq=0 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f52497fa640 1 -- 172.21.15.84:0/1909173579 <== mds.1 v2:172.21.15.175:6836/442498992 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55aa1e62c220 con 0x55aa1e709660 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f52497fa640 10 client.4953 handle_command_reply: tid=0 2024-04-14T10:58:36.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 client.4953 shutdown 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 msgr2=0x55aa1e7754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e7754a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f525c009870 tx=0x7f525c03c070 comp rx=0 tx=0).stop 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 shutdown_connections 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:6836/442498992,v1:172.21.15.175:6837/442498992] conn(0x55aa1e709660 0x55aa1e703530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55aa1e6fd6a0 0x55aa1e7754a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f52497fa640 0 client.4953 ms_handle_reset on v2:172.21.15.175:6836/442498992 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55aa1e6bf7e0 0x55aa1e7110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 --2- 172.21.15.84:0/1909173579 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aa1e6be240 0x55aa1e724780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 >> 172.21.15.84:0/1909173579 conn(0x55aa1e6e8f50 msgr2=0x55aa1e6be750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 shutdown_connections 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 1 -- 172.21.15.84:0/1909173579 wait complete. 2024-04-14T10:58:36.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526f210740 20 client.4953 trim_cache size 0 max 16384 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "8f4fd445-3fea-4722-8345-0096c2ce143b", 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4303, 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 26.838878442999999, 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 13, 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 20, 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 20, 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 39.030608663999999 2024-04-14T10:58:36.069 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f525006c920 msgr2=0x7f525006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526c42d640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f525006c920 0x7f525006ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5254007fd0 tx=0x7f5254009040 comp rx=0 tx=0).stop 2024-04-14T10:58:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 msgr2=0x7f52641515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.062+0000 7f526c42d640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 0x7f52641515b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f525c02b950 tx=0x7f525c0046c0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 shutdown_connections 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f525006c920 0x7f525006ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5264152fc0 0x7f52641515b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f526406fff0 0x7f5264151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 --2- 172.21.15.84:0/1224228135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f526406b900 0x7f526415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 >> 172.21.15.84:0/1224228135 conn(0x7f52640c9f70 msgr2=0x7f5264159590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 shutdown_connections 2024-04-14T10:58:36.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.063+0000 7f526c42d640 1 -- 172.21.15.84:0/1224228135 wait complete. 2024-04-14T10:58:36.072 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-14T10:58:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.177+0000 7f824d6b7640 1 Processor -- start 2024-04-14T10:58:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.177+0000 7f824d6b7640 1 -- start start 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.177+0000 7f824d6b7640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82481512c0 0x7f82480c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.177+0000 7f824d6b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f824806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.177+0000 7f824d6b7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8248071fc0 0x7f824806f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.177+0000 7f824d6b7640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f82480c6ff0 con 0x7f82481512c0 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f824d6b7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8248157bb0 con 0x7f8248071fc0 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f824d6b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82480726a0 con 0x7f82480c79c0 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82481512c0 0x7f82480c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f82481512c0 0x7f82480c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53672/0 (socket says 172.21.15.84:53672) 2024-04-14T10:58:36.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 -- 172.21.15.84:0/11479946 learned_addr learned my addr 172.21.15.84:0/11479946 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f82467fc640 1 --2- 172.21.15.84:0/11479946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f824806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f82477fe640 1 --2- 172.21.15.84:0/11479946 >> v2:172.21.15.175:3300/0 conn(0x7f8248071fc0 0x7f824806f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 -- 172.21.15.84:0/11479946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 msgr2=0x7f824806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 --2- 172.21.15.84:0/11479946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f824806f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 -- 172.21.15.84:0/11479946 >> v2:172.21.15.175:3300/0 conn(0x7f8248071fc0 msgr2=0x7f824806f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 --2- 172.21.15.84:0/11479946 >> v2:172.21.15.175:3300/0 conn(0x7f8248071fc0 0x7f824806f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.178+0000 7f8246ffd640 1 -- 172.21.15.84:0/11479946 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8248157e20 con 0x7f82481512c0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f8246ffd640 1 --2- 172.21.15.84:0/11479946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f82480c7480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f824806fd00 tx=0x7f823802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a421745610365868 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f8245ffb640 1 -- 172.21.15.84:0/11479946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238034070 con 0x7f82481512c0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f8245ffb640 1 -- 172.21.15.84:0/11479946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8238030860 con 0x7f82481512c0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f8245ffb640 1 -- 172.21.15.84:0/11479946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238030c30 con 0x7f82481512c0 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 -- 172.21.15.84:0/11479946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 msgr2=0x7f82480c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 --2- 172.21.15.84:0/11479946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f82480c7480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f824806fd00 tx=0x7f823802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 -- 172.21.15.84:0/11479946 shutdown_connections 2024-04-14T10:58:36.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 --2- 172.21.15.84:0/11479946 >> v2:172.21.15.175:3300/0 conn(0x7f8248071fc0 0x7f824806f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 --2- 172.21.15.84:0/11479946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f824806f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 --2- 172.21.15.84:0/11479946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f82480c7480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.179+0000 7f824d6b7640 1 -- 172.21.15.84:0/11479946 >> 172.21.15.84:0/11479946 conn(0x7f824806b900 msgr2=0x7f824806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.180+0000 7f824d6b7640 1 -- 172.21.15.84:0/11479946 shutdown_connections 2024-04-14T10:58:36.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.180+0000 7f824d6b7640 1 -- 172.21.15.84:0/11479946 wait complete. 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 Processor -- start 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 -- start start 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8248071fc0 0x7f8248161fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f82480c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f8248162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82480c8320 con 0x7f82481512c0 2024-04-14T10:58:36.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8248071820 con 0x7f8248071fc0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.181+0000 7f824d6b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82481516a0 con 0x7f82480c79c0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f8248162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f8248162c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53682/0 (socket says 172.21.15.84:53682) 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 -- 172.21.15.84:0/1064429659 learned_addr learned my addr 172.21.15.84:0/1064429659 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82467fc640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f82480c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8248071fc0 0x7f8248161fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 -- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 msgr2=0x7f82480c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f82480c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 -- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8248071fc0 msgr2=0x7f8248161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8248071fc0 0x7f8248161fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 -- 172.21.15.84:0/1064429659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824815ff90 con 0x7f82481512c0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82467fc640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f82480c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f82477fe640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f8248162c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8240007e60 tx=0x7f824000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f822f7fe640 1 -- 172.21.15.84:0/1064429659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240014420 con 0x7f82481512c0 2024-04-14T10:58:36.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f822f7fe640 1 -- 172.21.15.84:0/1064429659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8240019070 con 0x7f82481512c0 2024-04-14T10:58:36.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f822f7fe640 1 -- 172.21.15.84:0/1064429659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240014800 con 0x7f82481512c0 2024-04-14T10:58:36.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8248160270 con 0x7f82481512c0 2024-04-14T10:58:36.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.182+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8248160830 con 0x7f82481512c0 2024-04-14T10:58:36.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.184+0000 7f822f7fe640 1 -- 172.21.15.84:0/1064429659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82400149a0 con 0x7f82481512c0 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.184+0000 7f822f7fe640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f823406c920 0x7f823406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.184+0000 7f822f7fe640 1 -- 172.21.15.84:0/1064429659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f824008c320 con 0x7f82481512c0 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.185+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f823406c920 0x7f823406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.185+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f823406c920 0x7f823406ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8238036000 tx=0x7f823803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.185+0000 7f8250579740 1 Processor -- start 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 -- start start 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f55e7e0 0x56100f55ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f5a8660 0x56100f55f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 0x56100f59e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56100f4c3990 con 0x56100f55d240 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56100f46a620 con 0x56100f5a8660 2024-04-14T10:58:36.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56100f4bf950 con 0x56100f55e7e0 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f82477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 0x56100f59e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f82477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 0x56100f59e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53688/0 (socket says 172.21.15.84:53688) 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f82477fe640 1 -- 172.21.15.84:0/3757131876 learned_addr learned my addr 172.21.15.84:0/3757131876 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f8246ffd640 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f55e7e0 0x56100f55ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.186+0000 7f82467fc640 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f5a8660 0x56100f55f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82477fe640 1 -- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f55e7e0 msgr2=0x56100f55ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82477fe640 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f55e7e0 0x56100f55ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82477fe640 1 -- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f5a8660 msgr2=0x56100f55f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82477fe640 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f5a8660 0x56100f55f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82477fe640 1 -- 172.21.15.84:0/3757131876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100f1d62d0 con 0x56100f55d240 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82467fc640 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f5a8660 0x56100f55f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f82477fe640 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 0x56100f59e040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8240062710 tx=0x7f824005a820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebbefce2e0d8290 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f822cff9640 1 -- 172.21.15.84:0/3757131876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240062c40 con 0x56100f55d240 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f822cff9640 1 -- 172.21.15.84:0/3757131876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824008c0b0 con 0x56100f55d240 2024-04-14T10:58:36.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f822cff9640 1 -- 172.21.15.84:0/3757131876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240012dc0 con 0x56100f55d240 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f8250579740 1 -- 172.21.15.84:0/3757131876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 msgr2=0x56100f59e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.187+0000 7f8250579740 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 0x56100f59e040 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8240062710 tx=0x7f824005a820 comp rx=0 tx=0).stop 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 -- 172.21.15.84:0/3757131876 shutdown_connections 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f55d240 0x56100f59e040 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f5a8660 0x56100f55f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 --2- 172.21.15.84:0/3757131876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f55e7e0 0x56100f55ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 -- 172.21.15.84:0/3757131876 >> 172.21.15.84:0/3757131876 conn(0x56100f55af50 msgr2=0x56100f55d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 -- 172.21.15.84:0/3757131876 shutdown_connections 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.188+0000 7f8250579740 1 -- 172.21.15.84:0/3757131876 wait complete. 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.189+0000 7f8250579740 1 -- start start 2024-04-14T10:58:36.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.189+0000 7f8250579740 1 Processor -- start 2024-04-14T10:58:36.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f588030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f583f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56100f583d40 con 0x56100f5a8660 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56100f47d9e0 con 0x56100f55e7e0 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56100f55c100 con 0x56100f5b2d40 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8250579740 10 client.0 _ll_register_callbacks cb 0x56100f4b9220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53694/0 (socket says 172.21.15.84:53694) 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 -- 172.21.15.84:0/1442654472 learned_addr learned my addr 172.21.15.84:0/1442654472 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82477fe640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f583f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 -- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 msgr2=0x56100f583f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f583f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f588030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 -- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 msgr2=0x56100f588030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f588030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 -- 172.21.15.84:0/1442654472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100f2a06b0 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82477fe640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f583f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f588030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f82467fc640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59bc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f823c00df90 tx=0x7f823c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7efffd6db4e778c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8225ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.190+0000 7f8225ffb640 1 -- 172.21.15.84:0/1442654472 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c018070 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8225ffb640 1 -- 172.21.15.84:0/1442654472 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f823c004220 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f824008c0b0 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8225ffb640 1 -- 172.21.15.84:0/1442654472 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f823c022050 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 10 client.4965 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56100f59b720 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8225ffb640 1 -- 172.21.15.84:0/1442654472 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824008c0b0 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8225ffb640 1 -- 172.21.15.84:0/1442654472 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f823c025020 con 0x56100f5a8660 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 10 client.4965 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 10 client.4965 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-14T10:58:36.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 20 client.4965 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f5a42c0 0x56100f5be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 4 client.4965 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56100f4d13b0 con 0x56100f5a42c0 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.191+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f5a42c0 0x56100f5be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.192+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f5a42c0 0x56100f5be780 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e2b503d82a68b7 server_cookie=4322a0852027c0e8 in_seq=0 out_seq=0 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.192+0000 7f8225ffb640 10 client.4965 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.192+0000 7f8225ffb640 1 -- 172.21.15.84:0/1442654472 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56100f4d13b0 con 0x56100f5a42c0 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.192+0000 7f8225ffb640 10 client.4965 handle_command_reply: tid=0 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.192+0000 7f8250579740 1 client.4965 shutdown 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 msgr2=0x56100f59bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59bc40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f823c00df90 tx=0x7f823c00f670 comp rx=0 tx=0).stop 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 shutdown_connections 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f5a42c0 0x56100f5be780 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f583f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59bc40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 --2- 172.21.15.84:0/1442654472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f588030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 >> 172.21.15.84:0/1442654472 conn(0x56100f55d240 msgr2=0x56100f557c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8225ffb640 0 client.4965 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:36.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 shutdown_connections 2024-04-14T10:58:36.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 1 -- 172.21.15.84:0/1442654472 wait complete. 2024-04-14T10:58:36.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.193+0000 7f8250579740 20 client.4965 trim_cache size 0 max 16384 2024-04-14T10:58:36.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.230+0000 7f8250579740 1 Processor -- start 2024-04-14T10:58:36.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.230+0000 7f8250579740 1 -- start start 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f59c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8250579740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f5b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8250579740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8248156a50 con 0x56100f5a8660 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56100f5a74b0 con 0x56100f55e7e0 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56100f59ef10 con 0x56100f5b2d40 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53706/0 (socket says 172.21.15.84:53706) 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 -- 172.21.15.84:0/3479900407 learned_addr learned my addr 172.21.15.84:0/3479900407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82477fe640 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f5b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8246ffd640 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f59c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 -- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 msgr2=0x56100f5b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f5b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 -- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 msgr2=0x56100f59c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f59c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 -- 172.21.15.84:0/3479900407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100f59f090 con 0x56100f5a8660 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f82467fc640 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59c840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f823c001eb0 tx=0x7f823c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e9b850ace3d758 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8227fff640 1 -- 172.21.15.84:0/3479900407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c018070 con 0x56100f5a8660 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8227fff640 1 -- 172.21.15.84:0/3479900407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c0147d0 con 0x56100f5a8660 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.232+0000 7f8227fff640 1 -- 172.21.15.84:0/3479900407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c014be0 con 0x56100f5a8660 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 -- 172.21.15.84:0/3479900407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 msgr2=0x56100f59c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59c840 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f823c001eb0 tx=0x7f823c014000 comp rx=0 tx=0).stop 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 -- 172.21.15.84:0/3479900407 shutdown_connections 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f5b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f59c840 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 --2- 172.21.15.84:0/3479900407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f59c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 -- 172.21.15.84:0/3479900407 >> 172.21.15.84:0/3479900407 conn(0x56100f55d240 msgr2=0x56100f55c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 -- 172.21.15.84:0/3479900407 shutdown_connections 2024-04-14T10:58:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.233+0000 7f8250579740 1 -- 172.21.15.84:0/3479900407 wait complete. 2024-04-14T10:58:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 -- start start 2024-04-14T10:58:36.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 Processor -- start 2024-04-14T10:58:36.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f5c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f613b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f6140a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56100f5a4790 con 0x56100f5a8660 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56100f5a4140 con 0x56100f55e7e0 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56100f582240 con 0x56100f5b2d40 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.234+0000 7f8250579740 10 client.0 _ll_register_callbacks cb 0x7f823c00d1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f613b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f613b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53722/0 (socket says 172.21.15.84:53722) 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 -- 172.21.15.84:0/1940857999 learned_addr learned my addr 172.21.15.84:0/1940857999 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f5c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82477fe640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f6140a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 -- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 msgr2=0x56100f6140a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f6140a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 -- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 msgr2=0x56100f5c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f5c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 -- 172.21.15.84:0/1940857999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100f55cc90 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f82467fc640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f613b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f823c000c00 tx=0x7f823c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158fb47ac4e57453 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8225ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8225ffb640 1 -- 172.21.15.84:0/1940857999 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c032020 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8225ffb640 1 -- 172.21.15.84:0/1940857999 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f823c02e610 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f823c0147d0 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8225ffb640 1 -- 172.21.15.84:0/1940857999 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f823c018070 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8250579740 10 client.4971 fetch_fsmap learned FSMap version 13 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56100f584290 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.235+0000 7f8225ffb640 1 -- 172.21.15.84:0/1940857999 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823c0147d0 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8225ffb640 1 -- 172.21.15.84:0/1940857999 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f823c025030 con 0x56100f5a8660 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8250579740 10 client.4971 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8250579740 10 client.4971 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8250579740 20 client.4971 populate_metadata read hostname 'smithi084' 2024-04-14T10:58:36.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8250579740 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f59a340 0x56100f626540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8250579740 4 client.4971 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "status"}) -- 0x56100f4cb220 con 0x56100f59a340 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f59a340 0x56100f626540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8246ffd640 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f59a340 0x56100f626540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360a47d6e1bc83e1 server_cookie=51f17e5443751c94 in_seq=0 out_seq=0 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.236+0000 7f8225ffb640 10 client.4971 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8225ffb640 1 -- 172.21.15.84:0/1940857999 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56100f4cb220 con 0x56100f59a340 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8225ffb640 10 client.4971 handle_command_reply: tid=0 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 client.4971 shutdown 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 msgr2=0x56100f613b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f613b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f823c000c00 tx=0x7f823c012000 comp rx=0 tx=0).stop 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 shutdown_connections 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56100f59a340 0x56100f626540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56100f5b2d40 0x56100f6140a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8225ffb640 0 client.4971 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56100f5a8660 0x56100f613b60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 --2- 172.21.15.84:0/1940857999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56100f55e7e0 0x56100f5c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 >> 172.21.15.84:0/1940857999 conn(0x56100f55d240 msgr2=0x56100f55ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 shutdown_connections 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 1 -- 172.21.15.84:0/1940857999 wait complete. 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f8250579740 20 client.4971 trim_cache size 0 max 16384 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "8f4fd445-3fea-4722-8345-0096c2ce143b", 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 4308, 2024-04-14T10:58:36.241 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 32.041555625000001, 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 13, 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 20, 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 20, 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 39.207587721000003 2024-04-14T10:58:36.242 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f823406c920 msgr2=0x7f823406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f823406c920 0x7f823406ede0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8238036000 tx=0x7f823803b040 comp rx=0 tx=0).stop 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 msgr2=0x7f8248162c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f8248162c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8240007e60 tx=0x7f824000e4b0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 shutdown_connections 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f823406c920 0x7f823406ede0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82481512c0 0x7f8248162c40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82480c79c0 0x7f82480c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 --2- 172.21.15.84:0/1064429659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8248071fc0 0x7f8248161fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.237+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 >> 172.21.15.84:0/1064429659 conn(0x7f824806b900 msgr2=0x7f824806bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.238+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 shutdown_connections 2024-04-14T10:58:36.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T10:58:36.238+0000 7f824d6b7640 1 -- 172.21.15.84:0/1064429659 wait complete. 2024-04-14T10:58:36.246 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 120 sec 2024-04-14T10:59:03.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:59:03.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:59:33.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:59:33.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:00:03.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:00:03.814 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:00:09.511 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to '605eb1656ce49fe7fede4f53b18852ac638918c7'. 2024-04-14T11:00:09.511 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.511 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-14T11:00:09.511 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-04-14T11:00:09.512 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at 605eb1656ce qa/suites/fs: add quiescer to the thrash suite 2024-04-14T11:00:09.516 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-14T11:00:09.546 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-14T11:00:09.548 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-14T11:00:09.548 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-14T11:00:10.197 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-14T11:00:10.268 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-14T11:00:10.309 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-14T11:00:10.310 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-14T11:00:10.310 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-14T11:00:10.350 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-14T11:00:10.354 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T11:00:10.354 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-14T11:00:10.410 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-04-14T11:00:10.411 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-04-14T11:00:10.411 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-04-14T11:00:10.475 INFO:tasks.workunit.client.0.smithi084.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-04-14T11:00:13.123 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir foo 2024-04-14T11:00:13.138 INFO:tasks.workunit.client.0.smithi084.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-04-14T11:00:13.610 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir foo/.snap/barsnap 2024-04-14T11:00:13.623 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-04-14T11:00:13.637 INFO:tasks.workunit.client.0.smithi084.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-04-14T11:00:14.330 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'passed: files are identical' 2024-04-14T11:00:14.331 INFO:tasks.workunit.client.0.smithi084.stdout:passed: files are identical 2024-04-14T11:00:14.331 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir foo/.snap/barsnap 2024-04-14T11:00:14.515 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:00:14.516 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:00:14.516 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:00:14.516 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:00:14.607 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-04-14T11:00:14.607 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-04-14T11:00:14.631 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 1 2024-04-14T11:00:14.633 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 2 2024-04-14T11:00:14.635 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 3 2024-04-14T11:00:14.637 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' -e file4 ']' 2024-04-14T11:00:14.637 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/snap1 2024-04-14T11:00:14.647 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 4 2024-04-14T11:00:14.649 INFO:tasks.workunit.client.0.smithi084.stderr:++ ls 2024-04-14T11:00:14.663 INFO:tasks.workunit.client.0.smithi084.stderr:+ now='file1 2024-04-14T11:00:14.663 INFO:tasks.workunit.client.0.smithi084.stderr:file2 2024-04-14T11:00:14.664 INFO:tasks.workunit.client.0.smithi084.stderr:file3 2024-04-14T11:00:14.664 INFO:tasks.workunit.client.0.smithi084.stderr:file4' 2024-04-14T11:00:14.664 INFO:tasks.workunit.client.0.smithi084.stderr:++ ls .snap/snap1 2024-04-14T11:00:14.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ then='file1 2024-04-14T11:00:14.670 INFO:tasks.workunit.client.0.smithi084.stderr:file2 2024-04-14T11:00:14.670 INFO:tasks.workunit.client.0.smithi084.stderr:file3' 2024-04-14T11:00:14.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir .snap/snap1 2024-04-14T11:00:14.676 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 'file1 2024-04-14T11:00:14.676 INFO:tasks.workunit.client.0.smithi084.stderr:file2 2024-04-14T11:00:14.677 INFO:tasks.workunit.client.0.smithi084.stderr:file3 2024-04-14T11:00:14.677 INFO:tasks.workunit.client.0.smithi084.stderr:file4' = 'file1 2024-04-14T11:00:14.677 INFO:tasks.workunit.client.0.smithi084.stderr:file2 2024-04-14T11:00:14.677 INFO:tasks.workunit.client.0.smithi084.stderr:file3' ']' 2024-04-14T11:00:14.677 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 1 2024-04-14T11:00:14.681 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 2 2024-04-14T11:00:14.687 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 3 2024-04-14T11:00:14.693 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/snap1 2024-04-14T11:00:14.700 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 4 2024-04-14T11:00:14.706 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir .snap/snap1 2024-04-14T11:00:14.714 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm file1 file2 file3 file4 2024-04-14T11:00:14.722 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:00:14.723 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:00:14.723 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:00:14.723 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:00:14.799 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-04-14T11:00:14.800 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-04-14T11:00:14.864 INFO:tasks.workunit.client.0.smithi084.stdout:Create dir 100 to 199 ... 2024-04-14T11:00:14.877 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 100 2024-04-14T11:00:14.898 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 101 2024-04-14T11:00:14.917 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 102 2024-04-14T11:00:14.938 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 103 2024-04-14T11:00:14.959 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 104 2024-04-14T11:00:14.978 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 105 2024-04-14T11:00:14.998 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 106 2024-04-14T11:00:15.018 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 107 2024-04-14T11:00:15.038 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 108 2024-04-14T11:00:15.059 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 109 2024-04-14T11:00:15.079 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 110 2024-04-14T11:00:15.099 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 111 2024-04-14T11:00:15.119 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 112 2024-04-14T11:00:15.138 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 113 2024-04-14T11:00:15.158 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 114 2024-04-14T11:00:15.178 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 115 2024-04-14T11:00:15.198 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 116 2024-04-14T11:00:15.218 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 117 2024-04-14T11:00:15.237 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 118 2024-04-14T11:00:15.257 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 119 2024-04-14T11:00:15.276 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 120 2024-04-14T11:00:15.295 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 121 2024-04-14T11:00:15.314 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 122 2024-04-14T11:00:15.333 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 123 2024-04-14T11:00:15.354 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 124 2024-04-14T11:00:15.374 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 125 2024-04-14T11:00:15.393 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 126 2024-04-14T11:00:15.414 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 127 2024-04-14T11:00:15.434 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 128 2024-04-14T11:00:15.453 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 129 2024-04-14T11:00:15.473 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 130 2024-04-14T11:00:15.493 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 131 2024-04-14T11:00:15.514 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 132 2024-04-14T11:00:15.534 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 133 2024-04-14T11:00:15.557 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 134 2024-04-14T11:00:15.578 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 135 2024-04-14T11:00:15.598 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 136 2024-04-14T11:00:15.617 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 137 2024-04-14T11:00:15.636 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 138 2024-04-14T11:00:15.658 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 139 2024-04-14T11:00:15.681 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 140 2024-04-14T11:00:15.701 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 141 2024-04-14T11:00:15.723 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 142 2024-04-14T11:00:15.742 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 143 2024-04-14T11:00:15.761 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 144 2024-04-14T11:00:15.782 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 145 2024-04-14T11:00:15.802 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 146 2024-04-14T11:00:15.822 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 147 2024-04-14T11:00:15.841 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 148 2024-04-14T11:00:15.862 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 149 2024-04-14T11:00:15.880 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 150 2024-04-14T11:00:15.900 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 151 2024-04-14T11:00:15.920 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 152 2024-04-14T11:00:15.940 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 153 2024-04-14T11:00:15.960 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 154 2024-04-14T11:00:15.980 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 155 2024-04-14T11:00:15.999 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 156 2024-04-14T11:00:16.020 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 157 2024-04-14T11:00:16.039 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 158 2024-04-14T11:00:16.060 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 159 2024-04-14T11:00:16.080 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 160 2024-04-14T11:00:16.099 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 161 2024-04-14T11:00:16.120 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 162 2024-04-14T11:00:16.140 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 163 2024-04-14T11:00:16.160 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 164 2024-04-14T11:00:16.179 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 165 2024-04-14T11:00:16.199 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 166 2024-04-14T11:00:16.218 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 167 2024-04-14T11:00:16.239 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 168 2024-04-14T11:00:16.259 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 169 2024-04-14T11:00:16.279 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 170 2024-04-14T11:00:16.304 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 171 2024-04-14T11:00:16.326 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 172 2024-04-14T11:00:16.345 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 173 2024-04-14T11:00:16.365 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 174 2024-04-14T11:00:16.385 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 175 2024-04-14T11:00:16.404 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 176 2024-04-14T11:00:16.424 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 177 2024-04-14T11:00:16.444 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 178 2024-04-14T11:00:16.465 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 179 2024-04-14T11:00:16.484 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 180 2024-04-14T11:00:16.503 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 181 2024-04-14T11:00:16.524 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 182 2024-04-14T11:00:16.812 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 183 2024-04-14T11:00:16.831 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 184 2024-04-14T11:00:16.851 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 185 2024-04-14T11:00:16.870 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 186 2024-04-14T11:00:16.890 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 187 2024-04-14T11:00:16.910 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 188 2024-04-14T11:00:16.931 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 189 2024-04-14T11:00:16.952 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 190 2024-04-14T11:00:16.972 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 191 2024-04-14T11:00:16.991 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 192 2024-04-14T11:00:17.011 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 193 2024-04-14T11:00:17.031 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 194 2024-04-14T11:00:17.050 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 195 2024-04-14T11:00:17.071 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 196 2024-04-14T11:00:17.091 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 197 2024-04-14T11:00:17.112 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 198 2024-04-14T11:00:17.131 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 199 2024-04-14T11:00:17.151 INFO:tasks.workunit.client.0.smithi084.stdout:Take first snapshot .snap/test1 2024-04-14T11:00:17.262 INFO:tasks.workunit.client.0.smithi084.stdout:Create dir 200 to 299 ... 2024-04-14T11:00:17.263 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 200 2024-04-14T11:00:17.594 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 201 2024-04-14T11:00:17.614 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 202 2024-04-14T11:00:17.633 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 203 2024-04-14T11:00:17.653 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 204 2024-04-14T11:00:17.683 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 205 2024-04-14T11:00:17.702 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 206 2024-04-14T11:00:17.720 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 207 2024-04-14T11:00:17.739 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 208 2024-04-14T11:00:17.757 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 209 2024-04-14T11:00:17.775 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 210 2024-04-14T11:00:17.792 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 211 2024-04-14T11:00:17.810 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 212 2024-04-14T11:00:17.828 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 213 2024-04-14T11:00:17.846 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 214 2024-04-14T11:00:17.864 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 215 2024-04-14T11:00:17.883 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 216 2024-04-14T11:00:17.901 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 217 2024-04-14T11:00:17.919 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 218 2024-04-14T11:00:17.937 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 219 2024-04-14T11:00:17.955 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 220 2024-04-14T11:00:17.974 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 221 2024-04-14T11:00:17.993 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 222 2024-04-14T11:00:18.011 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 223 2024-04-14T11:00:18.030 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 224 2024-04-14T11:00:18.048 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 225 2024-04-14T11:00:18.066 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 226 2024-04-14T11:00:18.086 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 227 2024-04-14T11:00:18.104 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 228 2024-04-14T11:00:18.124 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 229 2024-04-14T11:00:18.146 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 230 2024-04-14T11:00:18.165 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 231 2024-04-14T11:00:18.183 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 232 2024-04-14T11:00:18.202 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 233 2024-04-14T11:00:18.220 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 234 2024-04-14T11:00:18.240 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 235 2024-04-14T11:00:18.259 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 236 2024-04-14T11:00:18.277 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 237 2024-04-14T11:00:18.295 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 238 2024-04-14T11:00:18.314 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 239 2024-04-14T11:00:18.334 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 240 2024-04-14T11:00:18.353 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 241 2024-04-14T11:00:18.371 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 242 2024-04-14T11:00:18.390 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 243 2024-04-14T11:00:18.409 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 244 2024-04-14T11:00:18.429 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 245 2024-04-14T11:00:18.449 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 246 2024-04-14T11:00:18.470 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 247 2024-04-14T11:00:18.489 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 248 2024-04-14T11:00:18.507 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 249 2024-04-14T11:00:18.527 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 250 2024-04-14T11:00:18.553 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 251 2024-04-14T11:00:19.259 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 252 2024-04-14T11:00:19.279 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 253 2024-04-14T11:00:19.298 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 254 2024-04-14T11:00:19.318 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 255 2024-04-14T11:00:19.337 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 256 2024-04-14T11:00:19.356 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 257 2024-04-14T11:00:19.375 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 258 2024-04-14T11:00:19.394 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 259 2024-04-14T11:00:19.413 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 260 2024-04-14T11:00:19.432 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 261 2024-04-14T11:00:19.450 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 262 2024-04-14T11:00:19.468 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 263 2024-04-14T11:00:19.486 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 264 2024-04-14T11:00:19.505 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 265 2024-04-14T11:00:19.524 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 266 2024-04-14T11:00:19.544 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 267 2024-04-14T11:00:19.564 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 268 2024-04-14T11:00:19.582 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 269 2024-04-14T11:00:19.601 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 270 2024-04-14T11:00:19.619 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 271 2024-04-14T11:00:19.638 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 272 2024-04-14T11:00:19.665 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 273 2024-04-14T11:00:19.697 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 274 2024-04-14T11:00:19.719 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 275 2024-04-14T11:00:19.738 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 276 2024-04-14T11:00:19.757 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 277 2024-04-14T11:00:19.775 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 278 2024-04-14T11:00:19.793 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 279 2024-04-14T11:00:19.811 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 280 2024-04-14T11:00:19.831 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 281 2024-04-14T11:00:19.849 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 282 2024-04-14T11:00:19.867 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 283 2024-04-14T11:00:19.885 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 284 2024-04-14T11:00:19.903 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 285 2024-04-14T11:00:19.923 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 286 2024-04-14T11:00:19.944 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 287 2024-04-14T11:00:19.962 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 288 2024-04-14T11:00:19.981 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 289 2024-04-14T11:00:20.000 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 290 2024-04-14T11:00:20.019 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 291 2024-04-14T11:00:20.038 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 292 2024-04-14T11:00:20.058 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 293 2024-04-14T11:00:20.078 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 294 2024-04-14T11:00:20.098 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 295 2024-04-14T11:00:20.117 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 296 2024-04-14T11:00:20.135 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 297 2024-04-14T11:00:20.153 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 298 2024-04-14T11:00:20.172 INFO:tasks.workunit.client.0.smithi084.stdout: create dir 299 2024-04-14T11:00:20.191 INFO:tasks.workunit.client.0.smithi084.stdout:Create a snapshot in every first level dir ... 2024-04-14T11:00:20.359 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/.snap/snap-subdir-test 2024-04-14T11:00:20.367 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/30 file after the snapshot 2024-04-14T11:00:20.370 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/31 file after the snapshot 2024-04-14T11:00:20.371 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/32 file after the snapshot 2024-04-14T11:00:20.373 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/33 file after the snapshot 2024-04-14T11:00:20.375 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/34 file after the snapshot 2024-04-14T11:00:20.376 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/35 file after the snapshot 2024-04-14T11:00:20.378 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/36 file after the snapshot 2024-04-14T11:00:20.379 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/37 file after the snapshot 2024-04-14T11:00:20.381 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/38 file after the snapshot 2024-04-14T11:00:20.383 INFO:tasks.workunit.client.0.smithi084.stdout: create 100/39 file after the snapshot 2024-04-14T11:00:20.384 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/.snap/snap-subdir-test 2024-04-14T11:00:20.396 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/30 file after the snapshot 2024-04-14T11:00:20.399 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/31 file after the snapshot 2024-04-14T11:00:20.401 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/32 file after the snapshot 2024-04-14T11:00:20.402 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/33 file after the snapshot 2024-04-14T11:00:20.404 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/34 file after the snapshot 2024-04-14T11:00:20.406 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/35 file after the snapshot 2024-04-14T11:00:20.407 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/36 file after the snapshot 2024-04-14T11:00:20.409 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/37 file after the snapshot 2024-04-14T11:00:20.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/38 file after the snapshot 2024-04-14T11:00:20.412 INFO:tasks.workunit.client.0.smithi084.stdout: create 101/39 file after the snapshot 2024-04-14T11:00:20.414 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/.snap/snap-subdir-test 2024-04-14T11:00:20.427 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/30 file after the snapshot 2024-04-14T11:00:20.429 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/31 file after the snapshot 2024-04-14T11:00:20.431 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/32 file after the snapshot 2024-04-14T11:00:20.432 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/33 file after the snapshot 2024-04-14T11:00:20.434 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/34 file after the snapshot 2024-04-14T11:00:20.436 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/35 file after the snapshot 2024-04-14T11:00:20.438 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/36 file after the snapshot 2024-04-14T11:00:20.439 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/37 file after the snapshot 2024-04-14T11:00:20.441 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/38 file after the snapshot 2024-04-14T11:00:20.443 INFO:tasks.workunit.client.0.smithi084.stdout: create 102/39 file after the snapshot 2024-04-14T11:00:20.444 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/.snap/snap-subdir-test 2024-04-14T11:00:20.456 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/30 file after the snapshot 2024-04-14T11:00:20.459 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/31 file after the snapshot 2024-04-14T11:00:20.460 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/32 file after the snapshot 2024-04-14T11:00:20.462 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/33 file after the snapshot 2024-04-14T11:00:20.464 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/34 file after the snapshot 2024-04-14T11:00:20.465 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/35 file after the snapshot 2024-04-14T11:00:20.467 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/36 file after the snapshot 2024-04-14T11:00:20.469 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/37 file after the snapshot 2024-04-14T11:00:20.470 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/38 file after the snapshot 2024-04-14T11:00:20.472 INFO:tasks.workunit.client.0.smithi084.stdout: create 103/39 file after the snapshot 2024-04-14T11:00:20.473 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/.snap/snap-subdir-test 2024-04-14T11:00:20.485 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/30 file after the snapshot 2024-04-14T11:00:20.488 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/31 file after the snapshot 2024-04-14T11:00:20.489 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/32 file after the snapshot 2024-04-14T11:00:20.491 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/33 file after the snapshot 2024-04-14T11:00:20.493 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/34 file after the snapshot 2024-04-14T11:00:20.494 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/35 file after the snapshot 2024-04-14T11:00:20.496 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/36 file after the snapshot 2024-04-14T11:00:20.498 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/37 file after the snapshot 2024-04-14T11:00:20.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/38 file after the snapshot 2024-04-14T11:00:20.501 INFO:tasks.workunit.client.0.smithi084.stdout: create 104/39 file after the snapshot 2024-04-14T11:00:20.503 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/.snap/snap-subdir-test 2024-04-14T11:00:20.515 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/30 file after the snapshot 2024-04-14T11:00:20.517 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/31 file after the snapshot 2024-04-14T11:00:20.522 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/32 file after the snapshot 2024-04-14T11:00:20.522 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/33 file after the snapshot 2024-04-14T11:00:20.522 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/34 file after the snapshot 2024-04-14T11:00:20.524 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/35 file after the snapshot 2024-04-14T11:00:20.525 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/36 file after the snapshot 2024-04-14T11:00:20.527 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/37 file after the snapshot 2024-04-14T11:00:20.529 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/38 file after the snapshot 2024-04-14T11:00:20.530 INFO:tasks.workunit.client.0.smithi084.stdout: create 105/39 file after the snapshot 2024-04-14T11:00:20.532 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/.snap/snap-subdir-test 2024-04-14T11:00:20.545 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/30 file after the snapshot 2024-04-14T11:00:20.546 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/31 file after the snapshot 2024-04-14T11:00:20.548 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/32 file after the snapshot 2024-04-14T11:00:20.550 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/33 file after the snapshot 2024-04-14T11:00:20.551 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/34 file after the snapshot 2024-04-14T11:00:20.553 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/35 file after the snapshot 2024-04-14T11:00:20.555 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/36 file after the snapshot 2024-04-14T11:00:20.556 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/37 file after the snapshot 2024-04-14T11:00:20.558 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/38 file after the snapshot 2024-04-14T11:00:20.562 INFO:tasks.workunit.client.0.smithi084.stdout: create 106/39 file after the snapshot 2024-04-14T11:00:20.562 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/.snap/snap-subdir-test 2024-04-14T11:00:20.573 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/30 file after the snapshot 2024-04-14T11:00:20.575 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/31 file after the snapshot 2024-04-14T11:00:20.577 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/32 file after the snapshot 2024-04-14T11:00:20.580 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/33 file after the snapshot 2024-04-14T11:00:20.581 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/34 file after the snapshot 2024-04-14T11:00:20.583 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/35 file after the snapshot 2024-04-14T11:00:20.584 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/36 file after the snapshot 2024-04-14T11:00:20.586 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/37 file after the snapshot 2024-04-14T11:00:20.588 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/38 file after the snapshot 2024-04-14T11:00:20.590 INFO:tasks.workunit.client.0.smithi084.stdout: create 107/39 file after the snapshot 2024-04-14T11:00:20.591 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/.snap/snap-subdir-test 2024-04-14T11:00:20.604 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/30 file after the snapshot 2024-04-14T11:00:20.606 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/31 file after the snapshot 2024-04-14T11:00:20.608 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/32 file after the snapshot 2024-04-14T11:00:20.609 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/33 file after the snapshot 2024-04-14T11:00:20.611 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/34 file after the snapshot 2024-04-14T11:00:20.613 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/35 file after the snapshot 2024-04-14T11:00:20.615 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/36 file after the snapshot 2024-04-14T11:00:20.616 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/37 file after the snapshot 2024-04-14T11:00:20.618 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/38 file after the snapshot 2024-04-14T11:00:20.619 INFO:tasks.workunit.client.0.smithi084.stdout: create 108/39 file after the snapshot 2024-04-14T11:00:20.621 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/.snap/snap-subdir-test 2024-04-14T11:00:20.634 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/30 file after the snapshot 2024-04-14T11:00:20.636 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/31 file after the snapshot 2024-04-14T11:00:20.638 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/32 file after the snapshot 2024-04-14T11:00:20.640 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/33 file after the snapshot 2024-04-14T11:00:20.642 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/34 file after the snapshot 2024-04-14T11:00:20.643 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/35 file after the snapshot 2024-04-14T11:00:20.645 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/36 file after the snapshot 2024-04-14T11:00:20.646 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/37 file after the snapshot 2024-04-14T11:00:20.648 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/38 file after the snapshot 2024-04-14T11:00:20.650 INFO:tasks.workunit.client.0.smithi084.stdout: create 109/39 file after the snapshot 2024-04-14T11:00:20.651 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/.snap/snap-subdir-test 2024-04-14T11:00:20.664 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/30 file after the snapshot 2024-04-14T11:00:20.666 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/31 file after the snapshot 2024-04-14T11:00:20.668 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/32 file after the snapshot 2024-04-14T11:00:20.670 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/33 file after the snapshot 2024-04-14T11:00:20.671 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/34 file after the snapshot 2024-04-14T11:00:20.673 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/35 file after the snapshot 2024-04-14T11:00:20.675 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/36 file after the snapshot 2024-04-14T11:00:20.677 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/37 file after the snapshot 2024-04-14T11:00:20.678 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/38 file after the snapshot 2024-04-14T11:00:20.680 INFO:tasks.workunit.client.0.smithi084.stdout: create 110/39 file after the snapshot 2024-04-14T11:00:20.682 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/.snap/snap-subdir-test 2024-04-14T11:00:20.692 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/30 file after the snapshot 2024-04-14T11:00:20.852 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/31 file after the snapshot 2024-04-14T11:00:20.854 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/32 file after the snapshot 2024-04-14T11:00:20.856 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/33 file after the snapshot 2024-04-14T11:00:20.857 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/34 file after the snapshot 2024-04-14T11:00:20.859 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/35 file after the snapshot 2024-04-14T11:00:20.861 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/36 file after the snapshot 2024-04-14T11:00:20.863 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/37 file after the snapshot 2024-04-14T11:00:20.865 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/38 file after the snapshot 2024-04-14T11:00:20.866 INFO:tasks.workunit.client.0.smithi084.stdout: create 111/39 file after the snapshot 2024-04-14T11:00:20.868 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/.snap/snap-subdir-test 2024-04-14T11:00:21.001 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/30 file after the snapshot 2024-04-14T11:00:21.002 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/31 file after the snapshot 2024-04-14T11:00:21.004 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/32 file after the snapshot 2024-04-14T11:00:21.005 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/33 file after the snapshot 2024-04-14T11:00:21.007 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/34 file after the snapshot 2024-04-14T11:00:21.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/35 file after the snapshot 2024-04-14T11:00:21.010 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/36 file after the snapshot 2024-04-14T11:00:21.012 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/37 file after the snapshot 2024-04-14T11:00:21.014 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/38 file after the snapshot 2024-04-14T11:00:21.015 INFO:tasks.workunit.client.0.smithi084.stdout: create 112/39 file after the snapshot 2024-04-14T11:00:21.017 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/.snap/snap-subdir-test 2024-04-14T11:00:21.027 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/30 file after the snapshot 2024-04-14T11:00:21.029 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/31 file after the snapshot 2024-04-14T11:00:21.031 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/32 file after the snapshot 2024-04-14T11:00:21.032 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/33 file after the snapshot 2024-04-14T11:00:21.034 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/34 file after the snapshot 2024-04-14T11:00:21.036 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/35 file after the snapshot 2024-04-14T11:00:21.038 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/36 file after the snapshot 2024-04-14T11:00:21.039 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/37 file after the snapshot 2024-04-14T11:00:21.041 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/38 file after the snapshot 2024-04-14T11:00:21.043 INFO:tasks.workunit.client.0.smithi084.stdout: create 113/39 file after the snapshot 2024-04-14T11:00:21.044 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/.snap/snap-subdir-test 2024-04-14T11:00:21.054 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/30 file after the snapshot 2024-04-14T11:00:21.056 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/31 file after the snapshot 2024-04-14T11:00:21.058 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/32 file after the snapshot 2024-04-14T11:00:21.059 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/33 file after the snapshot 2024-04-14T11:00:21.061 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/34 file after the snapshot 2024-04-14T11:00:21.063 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/35 file after the snapshot 2024-04-14T11:00:21.064 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/36 file after the snapshot 2024-04-14T11:00:21.066 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/37 file after the snapshot 2024-04-14T11:00:21.067 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/38 file after the snapshot 2024-04-14T11:00:21.069 INFO:tasks.workunit.client.0.smithi084.stdout: create 114/39 file after the snapshot 2024-04-14T11:00:21.071 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/.snap/snap-subdir-test 2024-04-14T11:00:21.081 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/30 file after the snapshot 2024-04-14T11:00:21.083 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/31 file after the snapshot 2024-04-14T11:00:21.085 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/32 file after the snapshot 2024-04-14T11:00:21.086 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/33 file after the snapshot 2024-04-14T11:00:21.089 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/34 file after the snapshot 2024-04-14T11:00:21.091 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/35 file after the snapshot 2024-04-14T11:00:21.093 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/36 file after the snapshot 2024-04-14T11:00:21.095 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/37 file after the snapshot 2024-04-14T11:00:21.096 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/38 file after the snapshot 2024-04-14T11:00:21.098 INFO:tasks.workunit.client.0.smithi084.stdout: create 115/39 file after the snapshot 2024-04-14T11:00:21.100 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/.snap/snap-subdir-test 2024-04-14T11:00:21.110 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/30 file after the snapshot 2024-04-14T11:00:21.112 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/31 file after the snapshot 2024-04-14T11:00:21.113 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/32 file after the snapshot 2024-04-14T11:00:21.115 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/33 file after the snapshot 2024-04-14T11:00:21.117 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/34 file after the snapshot 2024-04-14T11:00:21.118 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/35 file after the snapshot 2024-04-14T11:00:21.120 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/36 file after the snapshot 2024-04-14T11:00:21.121 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/37 file after the snapshot 2024-04-14T11:00:21.123 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/38 file after the snapshot 2024-04-14T11:00:21.125 INFO:tasks.workunit.client.0.smithi084.stdout: create 116/39 file after the snapshot 2024-04-14T11:00:21.126 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/.snap/snap-subdir-test 2024-04-14T11:00:21.137 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/30 file after the snapshot 2024-04-14T11:00:21.139 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/31 file after the snapshot 2024-04-14T11:00:21.140 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/32 file after the snapshot 2024-04-14T11:00:21.142 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/33 file after the snapshot 2024-04-14T11:00:21.144 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/34 file after the snapshot 2024-04-14T11:00:21.147 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/35 file after the snapshot 2024-04-14T11:00:21.147 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/36 file after the snapshot 2024-04-14T11:00:21.149 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/37 file after the snapshot 2024-04-14T11:00:21.151 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/38 file after the snapshot 2024-04-14T11:00:21.153 INFO:tasks.workunit.client.0.smithi084.stdout: create 117/39 file after the snapshot 2024-04-14T11:00:21.155 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/.snap/snap-subdir-test 2024-04-14T11:00:21.165 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/30 file after the snapshot 2024-04-14T11:00:21.166 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/31 file after the snapshot 2024-04-14T11:00:21.168 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/32 file after the snapshot 2024-04-14T11:00:21.170 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/33 file after the snapshot 2024-04-14T11:00:21.172 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/34 file after the snapshot 2024-04-14T11:00:21.174 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/35 file after the snapshot 2024-04-14T11:00:21.175 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/36 file after the snapshot 2024-04-14T11:00:21.177 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/37 file after the snapshot 2024-04-14T11:00:21.179 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/38 file after the snapshot 2024-04-14T11:00:21.181 INFO:tasks.workunit.client.0.smithi084.stdout: create 118/39 file after the snapshot 2024-04-14T11:00:21.182 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/.snap/snap-subdir-test 2024-04-14T11:00:21.194 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/30 file after the snapshot 2024-04-14T11:00:21.195 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/31 file after the snapshot 2024-04-14T11:00:21.197 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/32 file after the snapshot 2024-04-14T11:00:21.198 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/33 file after the snapshot 2024-04-14T11:00:21.200 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/34 file after the snapshot 2024-04-14T11:00:21.201 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/35 file after the snapshot 2024-04-14T11:00:21.203 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/36 file after the snapshot 2024-04-14T11:00:21.204 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/37 file after the snapshot 2024-04-14T11:00:21.206 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/38 file after the snapshot 2024-04-14T11:00:21.208 INFO:tasks.workunit.client.0.smithi084.stdout: create 119/39 file after the snapshot 2024-04-14T11:00:21.209 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/.snap/snap-subdir-test 2024-04-14T11:00:21.220 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/30 file after the snapshot 2024-04-14T11:00:21.221 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/31 file after the snapshot 2024-04-14T11:00:21.223 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/32 file after the snapshot 2024-04-14T11:00:21.225 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/33 file after the snapshot 2024-04-14T11:00:21.226 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/34 file after the snapshot 2024-04-14T11:00:21.228 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/35 file after the snapshot 2024-04-14T11:00:21.230 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/36 file after the snapshot 2024-04-14T11:00:21.231 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/37 file after the snapshot 2024-04-14T11:00:21.233 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/38 file after the snapshot 2024-04-14T11:00:21.235 INFO:tasks.workunit.client.0.smithi084.stdout: create 120/39 file after the snapshot 2024-04-14T11:00:21.237 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/.snap/snap-subdir-test 2024-04-14T11:00:21.248 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/30 file after the snapshot 2024-04-14T11:00:21.249 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/31 file after the snapshot 2024-04-14T11:00:21.251 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/32 file after the snapshot 2024-04-14T11:00:21.254 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/33 file after the snapshot 2024-04-14T11:00:21.255 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/34 file after the snapshot 2024-04-14T11:00:21.257 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/35 file after the snapshot 2024-04-14T11:00:21.259 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/36 file after the snapshot 2024-04-14T11:00:21.260 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/37 file after the snapshot 2024-04-14T11:00:21.262 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/38 file after the snapshot 2024-04-14T11:00:21.264 INFO:tasks.workunit.client.0.smithi084.stdout: create 121/39 file after the snapshot 2024-04-14T11:00:21.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/.snap/snap-subdir-test 2024-04-14T11:00:21.285 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/30 file after the snapshot 2024-04-14T11:00:21.285 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/31 file after the snapshot 2024-04-14T11:00:21.285 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/32 file after the snapshot 2024-04-14T11:00:21.286 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/33 file after the snapshot 2024-04-14T11:00:21.286 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/34 file after the snapshot 2024-04-14T11:00:21.286 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/35 file after the snapshot 2024-04-14T11:00:21.288 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/36 file after the snapshot 2024-04-14T11:00:21.290 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/37 file after the snapshot 2024-04-14T11:00:21.292 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/38 file after the snapshot 2024-04-14T11:00:21.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 122/39 file after the snapshot 2024-04-14T11:00:21.296 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/.snap/snap-subdir-test 2024-04-14T11:00:21.307 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/30 file after the snapshot 2024-04-14T11:00:21.309 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/31 file after the snapshot 2024-04-14T11:00:21.310 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/32 file after the snapshot 2024-04-14T11:00:21.314 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/33 file after the snapshot 2024-04-14T11:00:21.314 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/34 file after the snapshot 2024-04-14T11:00:21.316 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/35 file after the snapshot 2024-04-14T11:00:21.317 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/36 file after the snapshot 2024-04-14T11:00:21.319 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/37 file after the snapshot 2024-04-14T11:00:21.320 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/38 file after the snapshot 2024-04-14T11:00:21.322 INFO:tasks.workunit.client.0.smithi084.stdout: create 123/39 file after the snapshot 2024-04-14T11:00:21.323 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/.snap/snap-subdir-test 2024-04-14T11:00:21.338 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/30 file after the snapshot 2024-04-14T11:00:21.338 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/31 file after the snapshot 2024-04-14T11:00:21.339 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/32 file after the snapshot 2024-04-14T11:00:21.341 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/33 file after the snapshot 2024-04-14T11:00:21.342 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/34 file after the snapshot 2024-04-14T11:00:21.344 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/35 file after the snapshot 2024-04-14T11:00:21.346 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/36 file after the snapshot 2024-04-14T11:00:21.348 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/37 file after the snapshot 2024-04-14T11:00:21.349 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/38 file after the snapshot 2024-04-14T11:00:21.351 INFO:tasks.workunit.client.0.smithi084.stdout: create 124/39 file after the snapshot 2024-04-14T11:00:21.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/.snap/snap-subdir-test 2024-04-14T11:00:21.363 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/30 file after the snapshot 2024-04-14T11:00:21.365 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/31 file after the snapshot 2024-04-14T11:00:21.367 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/32 file after the snapshot 2024-04-14T11:00:21.368 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/33 file after the snapshot 2024-04-14T11:00:21.370 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/34 file after the snapshot 2024-04-14T11:00:21.372 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/35 file after the snapshot 2024-04-14T11:00:21.373 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/36 file after the snapshot 2024-04-14T11:00:21.375 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/37 file after the snapshot 2024-04-14T11:00:21.377 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/38 file after the snapshot 2024-04-14T11:00:21.379 INFO:tasks.workunit.client.0.smithi084.stdout: create 125/39 file after the snapshot 2024-04-14T11:00:21.380 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/.snap/snap-subdir-test 2024-04-14T11:00:21.393 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/30 file after the snapshot 2024-04-14T11:00:21.395 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/31 file after the snapshot 2024-04-14T11:00:21.396 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/32 file after the snapshot 2024-04-14T11:00:21.398 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/33 file after the snapshot 2024-04-14T11:00:21.400 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/34 file after the snapshot 2024-04-14T11:00:21.402 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/35 file after the snapshot 2024-04-14T11:00:21.404 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/36 file after the snapshot 2024-04-14T11:00:21.405 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/37 file after the snapshot 2024-04-14T11:00:21.407 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/38 file after the snapshot 2024-04-14T11:00:21.409 INFO:tasks.workunit.client.0.smithi084.stdout: create 126/39 file after the snapshot 2024-04-14T11:00:21.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/.snap/snap-subdir-test 2024-04-14T11:00:21.422 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/30 file after the snapshot 2024-04-14T11:00:21.423 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/31 file after the snapshot 2024-04-14T11:00:21.425 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/32 file after the snapshot 2024-04-14T11:00:21.426 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/33 file after the snapshot 2024-04-14T11:00:21.428 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/34 file after the snapshot 2024-04-14T11:00:21.430 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/35 file after the snapshot 2024-04-14T11:00:21.432 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/36 file after the snapshot 2024-04-14T11:00:21.433 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/37 file after the snapshot 2024-04-14T11:00:21.435 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/38 file after the snapshot 2024-04-14T11:00:21.437 INFO:tasks.workunit.client.0.smithi084.stdout: create 127/39 file after the snapshot 2024-04-14T11:00:21.438 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/.snap/snap-subdir-test 2024-04-14T11:00:21.451 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/30 file after the snapshot 2024-04-14T11:00:21.453 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/31 file after the snapshot 2024-04-14T11:00:21.455 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/32 file after the snapshot 2024-04-14T11:00:21.456 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/33 file after the snapshot 2024-04-14T11:00:21.458 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/34 file after the snapshot 2024-04-14T11:00:21.460 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/35 file after the snapshot 2024-04-14T11:00:21.461 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/36 file after the snapshot 2024-04-14T11:00:21.463 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/37 file after the snapshot 2024-04-14T11:00:21.464 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/38 file after the snapshot 2024-04-14T11:00:21.466 INFO:tasks.workunit.client.0.smithi084.stdout: create 128/39 file after the snapshot 2024-04-14T11:00:21.468 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/.snap/snap-subdir-test 2024-04-14T11:00:21.478 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/30 file after the snapshot 2024-04-14T11:00:21.479 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/31 file after the snapshot 2024-04-14T11:00:21.481 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/32 file after the snapshot 2024-04-14T11:00:21.483 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/33 file after the snapshot 2024-04-14T11:00:21.484 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/34 file after the snapshot 2024-04-14T11:00:21.486 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/35 file after the snapshot 2024-04-14T11:00:21.487 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/36 file after the snapshot 2024-04-14T11:00:21.489 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/37 file after the snapshot 2024-04-14T11:00:21.491 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/38 file after the snapshot 2024-04-14T11:00:21.493 INFO:tasks.workunit.client.0.smithi084.stdout: create 129/39 file after the snapshot 2024-04-14T11:00:21.494 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/.snap/snap-subdir-test 2024-04-14T11:00:21.505 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/30 file after the snapshot 2024-04-14T11:00:21.506 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/31 file after the snapshot 2024-04-14T11:00:21.508 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/32 file after the snapshot 2024-04-14T11:00:21.509 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/33 file after the snapshot 2024-04-14T11:00:21.511 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/34 file after the snapshot 2024-04-14T11:00:21.513 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/35 file after the snapshot 2024-04-14T11:00:21.515 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/36 file after the snapshot 2024-04-14T11:00:21.517 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/37 file after the snapshot 2024-04-14T11:00:21.518 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/38 file after the snapshot 2024-04-14T11:00:21.520 INFO:tasks.workunit.client.0.smithi084.stdout: create 130/39 file after the snapshot 2024-04-14T11:00:21.521 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/.snap/snap-subdir-test 2024-04-14T11:00:21.532 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/30 file after the snapshot 2024-04-14T11:00:21.533 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/31 file after the snapshot 2024-04-14T11:00:21.535 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/32 file after the snapshot 2024-04-14T11:00:21.537 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/33 file after the snapshot 2024-04-14T11:00:21.538 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/34 file after the snapshot 2024-04-14T11:00:21.540 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/35 file after the snapshot 2024-04-14T11:00:21.541 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/36 file after the snapshot 2024-04-14T11:00:21.543 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/37 file after the snapshot 2024-04-14T11:00:21.545 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/38 file after the snapshot 2024-04-14T11:00:21.546 INFO:tasks.workunit.client.0.smithi084.stdout: create 131/39 file after the snapshot 2024-04-14T11:00:21.548 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/.snap/snap-subdir-test 2024-04-14T11:00:21.559 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/30 file after the snapshot 2024-04-14T11:00:21.560 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/31 file after the snapshot 2024-04-14T11:00:21.562 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/32 file after the snapshot 2024-04-14T11:00:21.564 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/33 file after the snapshot 2024-04-14T11:00:21.565 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/34 file after the snapshot 2024-04-14T11:00:21.567 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/35 file after the snapshot 2024-04-14T11:00:21.568 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/36 file after the snapshot 2024-04-14T11:00:21.570 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/37 file after the snapshot 2024-04-14T11:00:21.572 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/38 file after the snapshot 2024-04-14T11:00:21.573 INFO:tasks.workunit.client.0.smithi084.stdout: create 132/39 file after the snapshot 2024-04-14T11:00:21.575 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/.snap/snap-subdir-test 2024-04-14T11:00:21.585 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/30 file after the snapshot 2024-04-14T11:00:21.587 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/31 file after the snapshot 2024-04-14T11:00:21.588 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/32 file after the snapshot 2024-04-14T11:00:21.590 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/33 file after the snapshot 2024-04-14T11:00:21.592 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/34 file after the snapshot 2024-04-14T11:00:21.593 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/35 file after the snapshot 2024-04-14T11:00:21.595 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/36 file after the snapshot 2024-04-14T11:00:21.597 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/37 file after the snapshot 2024-04-14T11:00:21.599 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/38 file after the snapshot 2024-04-14T11:00:21.600 INFO:tasks.workunit.client.0.smithi084.stdout: create 133/39 file after the snapshot 2024-04-14T11:00:21.602 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/.snap/snap-subdir-test 2024-04-14T11:00:21.612 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/30 file after the snapshot 2024-04-14T11:00:21.614 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/31 file after the snapshot 2024-04-14T11:00:21.616 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/32 file after the snapshot 2024-04-14T11:00:21.617 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/33 file after the snapshot 2024-04-14T11:00:21.619 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/34 file after the snapshot 2024-04-14T11:00:21.620 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/35 file after the snapshot 2024-04-14T11:00:21.622 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/36 file after the snapshot 2024-04-14T11:00:21.624 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/37 file after the snapshot 2024-04-14T11:00:21.625 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/38 file after the snapshot 2024-04-14T11:00:21.627 INFO:tasks.workunit.client.0.smithi084.stdout: create 134/39 file after the snapshot 2024-04-14T11:00:21.628 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/.snap/snap-subdir-test 2024-04-14T11:00:21.639 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/30 file after the snapshot 2024-04-14T11:00:21.641 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/31 file after the snapshot 2024-04-14T11:00:21.642 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/32 file after the snapshot 2024-04-14T11:00:21.645 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/33 file after the snapshot 2024-04-14T11:00:21.646 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/34 file after the snapshot 2024-04-14T11:00:21.648 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/35 file after the snapshot 2024-04-14T11:00:21.649 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/36 file after the snapshot 2024-04-14T11:00:21.651 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/37 file after the snapshot 2024-04-14T11:00:21.652 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/38 file after the snapshot 2024-04-14T11:00:21.654 INFO:tasks.workunit.client.0.smithi084.stdout: create 135/39 file after the snapshot 2024-04-14T11:00:21.656 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/.snap/snap-subdir-test 2024-04-14T11:00:21.667 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/30 file after the snapshot 2024-04-14T11:00:21.668 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/31 file after the snapshot 2024-04-14T11:00:21.670 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/32 file after the snapshot 2024-04-14T11:00:21.672 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/33 file after the snapshot 2024-04-14T11:00:21.674 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/34 file after the snapshot 2024-04-14T11:00:21.675 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/35 file after the snapshot 2024-04-14T11:00:21.677 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/36 file after the snapshot 2024-04-14T11:00:21.678 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/37 file after the snapshot 2024-04-14T11:00:21.680 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/38 file after the snapshot 2024-04-14T11:00:21.682 INFO:tasks.workunit.client.0.smithi084.stdout: create 136/39 file after the snapshot 2024-04-14T11:00:21.684 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/.snap/snap-subdir-test 2024-04-14T11:00:21.694 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/30 file after the snapshot 2024-04-14T11:00:21.695 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/31 file after the snapshot 2024-04-14T11:00:21.697 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/32 file after the snapshot 2024-04-14T11:00:21.699 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/33 file after the snapshot 2024-04-14T11:00:21.700 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/34 file after the snapshot 2024-04-14T11:00:21.702 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/35 file after the snapshot 2024-04-14T11:00:21.704 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/36 file after the snapshot 2024-04-14T11:00:21.705 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/37 file after the snapshot 2024-04-14T11:00:21.707 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/38 file after the snapshot 2024-04-14T11:00:21.709 INFO:tasks.workunit.client.0.smithi084.stdout: create 137/39 file after the snapshot 2024-04-14T11:00:21.896 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/.snap/snap-subdir-test 2024-04-14T11:00:21.958 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/30 file after the snapshot 2024-04-14T11:00:21.959 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/31 file after the snapshot 2024-04-14T11:00:21.961 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/32 file after the snapshot 2024-04-14T11:00:21.962 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/33 file after the snapshot 2024-04-14T11:00:21.964 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/34 file after the snapshot 2024-04-14T11:00:21.966 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/35 file after the snapshot 2024-04-14T11:00:21.967 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/36 file after the snapshot 2024-04-14T11:00:21.969 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/37 file after the snapshot 2024-04-14T11:00:21.971 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/38 file after the snapshot 2024-04-14T11:00:21.973 INFO:tasks.workunit.client.0.smithi084.stdout: create 138/39 file after the snapshot 2024-04-14T11:00:21.975 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/.snap/snap-subdir-test 2024-04-14T11:00:21.986 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/30 file after the snapshot 2024-04-14T11:00:21.988 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/31 file after the snapshot 2024-04-14T11:00:21.989 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/32 file after the snapshot 2024-04-14T11:00:21.991 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/33 file after the snapshot 2024-04-14T11:00:21.992 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/34 file after the snapshot 2024-04-14T11:00:21.994 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/35 file after the snapshot 2024-04-14T11:00:21.996 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/36 file after the snapshot 2024-04-14T11:00:21.998 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/37 file after the snapshot 2024-04-14T11:00:21.999 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/38 file after the snapshot 2024-04-14T11:00:22.001 INFO:tasks.workunit.client.0.smithi084.stdout: create 139/39 file after the snapshot 2024-04-14T11:00:22.002 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/.snap/snap-subdir-test 2024-04-14T11:00:22.013 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/30 file after the snapshot 2024-04-14T11:00:22.015 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/31 file after the snapshot 2024-04-14T11:00:22.017 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/32 file after the snapshot 2024-04-14T11:00:22.018 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/33 file after the snapshot 2024-04-14T11:00:22.020 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/34 file after the snapshot 2024-04-14T11:00:22.021 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/35 file after the snapshot 2024-04-14T11:00:22.023 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/36 file after the snapshot 2024-04-14T11:00:22.025 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/37 file after the snapshot 2024-04-14T11:00:22.027 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/38 file after the snapshot 2024-04-14T11:00:22.029 INFO:tasks.workunit.client.0.smithi084.stdout: create 140/39 file after the snapshot 2024-04-14T11:00:22.030 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/.snap/snap-subdir-test 2024-04-14T11:00:22.041 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/30 file after the snapshot 2024-04-14T11:00:22.042 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/31 file after the snapshot 2024-04-14T11:00:22.044 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/32 file after the snapshot 2024-04-14T11:00:22.046 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/33 file after the snapshot 2024-04-14T11:00:22.048 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/34 file after the snapshot 2024-04-14T11:00:22.050 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/35 file after the snapshot 2024-04-14T11:00:22.052 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/36 file after the snapshot 2024-04-14T11:00:22.053 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/37 file after the snapshot 2024-04-14T11:00:22.055 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/38 file after the snapshot 2024-04-14T11:00:22.056 INFO:tasks.workunit.client.0.smithi084.stdout: create 141/39 file after the snapshot 2024-04-14T11:00:22.058 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/.snap/snap-subdir-test 2024-04-14T11:00:22.069 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/30 file after the snapshot 2024-04-14T11:00:22.070 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/31 file after the snapshot 2024-04-14T11:00:22.072 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/32 file after the snapshot 2024-04-14T11:00:22.073 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/33 file after the snapshot 2024-04-14T11:00:22.075 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/34 file after the snapshot 2024-04-14T11:00:22.077 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/35 file after the snapshot 2024-04-14T11:00:22.079 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/36 file after the snapshot 2024-04-14T11:00:22.081 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/37 file after the snapshot 2024-04-14T11:00:22.082 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/38 file after the snapshot 2024-04-14T11:00:22.083 INFO:tasks.workunit.client.0.smithi084.stdout: create 142/39 file after the snapshot 2024-04-14T11:00:22.085 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/.snap/snap-subdir-test 2024-04-14T11:00:22.097 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/30 file after the snapshot 2024-04-14T11:00:22.098 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/31 file after the snapshot 2024-04-14T11:00:22.100 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/32 file after the snapshot 2024-04-14T11:00:22.102 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/33 file after the snapshot 2024-04-14T11:00:22.104 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/34 file after the snapshot 2024-04-14T11:00:22.106 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/35 file after the snapshot 2024-04-14T11:00:22.107 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/36 file after the snapshot 2024-04-14T11:00:22.109 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/37 file after the snapshot 2024-04-14T11:00:22.111 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/38 file after the snapshot 2024-04-14T11:00:22.112 INFO:tasks.workunit.client.0.smithi084.stdout: create 143/39 file after the snapshot 2024-04-14T11:00:22.114 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/.snap/snap-subdir-test 2024-04-14T11:00:22.125 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/30 file after the snapshot 2024-04-14T11:00:22.127 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/31 file after the snapshot 2024-04-14T11:00:22.128 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/32 file after the snapshot 2024-04-14T11:00:22.130 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/33 file after the snapshot 2024-04-14T11:00:22.132 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/34 file after the snapshot 2024-04-14T11:00:22.133 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/35 file after the snapshot 2024-04-14T11:00:22.135 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/36 file after the snapshot 2024-04-14T11:00:22.137 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/37 file after the snapshot 2024-04-14T11:00:22.139 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/38 file after the snapshot 2024-04-14T11:00:22.140 INFO:tasks.workunit.client.0.smithi084.stdout: create 144/39 file after the snapshot 2024-04-14T11:00:22.142 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/.snap/snap-subdir-test 2024-04-14T11:00:22.153 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/30 file after the snapshot 2024-04-14T11:00:22.154 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/31 file after the snapshot 2024-04-14T11:00:22.158 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/32 file after the snapshot 2024-04-14T11:00:22.158 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/33 file after the snapshot 2024-04-14T11:00:22.159 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/34 file after the snapshot 2024-04-14T11:00:22.161 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/35 file after the snapshot 2024-04-14T11:00:22.163 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/36 file after the snapshot 2024-04-14T11:00:22.164 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/37 file after the snapshot 2024-04-14T11:00:22.166 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/38 file after the snapshot 2024-04-14T11:00:22.168 INFO:tasks.workunit.client.0.smithi084.stdout: create 145/39 file after the snapshot 2024-04-14T11:00:22.169 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/.snap/snap-subdir-test 2024-04-14T11:00:22.180 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/30 file after the snapshot 2024-04-14T11:00:22.181 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/31 file after the snapshot 2024-04-14T11:00:22.183 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/32 file after the snapshot 2024-04-14T11:00:22.184 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/33 file after the snapshot 2024-04-14T11:00:22.186 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/34 file after the snapshot 2024-04-14T11:00:22.187 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/35 file after the snapshot 2024-04-14T11:00:22.189 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/36 file after the snapshot 2024-04-14T11:00:22.191 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/37 file after the snapshot 2024-04-14T11:00:22.192 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/38 file after the snapshot 2024-04-14T11:00:22.194 INFO:tasks.workunit.client.0.smithi084.stdout: create 146/39 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/.snap/snap-subdir-test 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/30 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/31 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/32 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/33 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/34 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/35 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/36 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/37 file after the snapshot 2024-04-14T11:00:22.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/38 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 147/39 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/.snap/snap-subdir-test 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/30 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/31 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/32 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/33 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/34 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/35 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/36 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/37 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/38 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 148/39 file after the snapshot 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/.snap/snap-subdir-test 2024-04-14T11:00:22.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/30 file after the snapshot 2024-04-14T11:00:22.267 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/31 file after the snapshot 2024-04-14T11:00:22.267 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/32 file after the snapshot 2024-04-14T11:00:22.267 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/33 file after the snapshot 2024-04-14T11:00:22.269 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/34 file after the snapshot 2024-04-14T11:00:22.270 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/35 file after the snapshot 2024-04-14T11:00:22.272 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/36 file after the snapshot 2024-04-14T11:00:22.274 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/37 file after the snapshot 2024-04-14T11:00:22.276 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/38 file after the snapshot 2024-04-14T11:00:22.278 INFO:tasks.workunit.client.0.smithi084.stdout: create 149/39 file after the snapshot 2024-04-14T11:00:22.279 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/.snap/snap-subdir-test 2024-04-14T11:00:22.293 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/30 file after the snapshot 2024-04-14T11:00:22.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/31 file after the snapshot 2024-04-14T11:00:22.296 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/32 file after the snapshot 2024-04-14T11:00:22.299 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/33 file after the snapshot 2024-04-14T11:00:22.300 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/34 file after the snapshot 2024-04-14T11:00:22.301 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/35 file after the snapshot 2024-04-14T11:00:22.303 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/36 file after the snapshot 2024-04-14T11:00:22.305 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/37 file after the snapshot 2024-04-14T11:00:22.306 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/38 file after the snapshot 2024-04-14T11:00:22.308 INFO:tasks.workunit.client.0.smithi084.stdout: create 150/39 file after the snapshot 2024-04-14T11:00:22.310 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/.snap/snap-subdir-test 2024-04-14T11:00:22.321 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/30 file after the snapshot 2024-04-14T11:00:22.322 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/31 file after the snapshot 2024-04-14T11:00:22.324 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/32 file after the snapshot 2024-04-14T11:00:22.326 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/33 file after the snapshot 2024-04-14T11:00:22.328 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/34 file after the snapshot 2024-04-14T11:00:22.329 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/35 file after the snapshot 2024-04-14T11:00:22.331 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/36 file after the snapshot 2024-04-14T11:00:22.332 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/37 file after the snapshot 2024-04-14T11:00:22.334 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/38 file after the snapshot 2024-04-14T11:00:22.336 INFO:tasks.workunit.client.0.smithi084.stdout: create 151/39 file after the snapshot 2024-04-14T11:00:22.337 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/.snap/snap-subdir-test 2024-04-14T11:00:22.351 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/30 file after the snapshot 2024-04-14T11:00:22.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/31 file after the snapshot 2024-04-14T11:00:22.354 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/32 file after the snapshot 2024-04-14T11:00:22.358 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/33 file after the snapshot 2024-04-14T11:00:22.358 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/34 file after the snapshot 2024-04-14T11:00:22.359 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/35 file after the snapshot 2024-04-14T11:00:22.360 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/36 file after the snapshot 2024-04-14T11:00:22.362 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/37 file after the snapshot 2024-04-14T11:00:22.364 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/38 file after the snapshot 2024-04-14T11:00:22.365 INFO:tasks.workunit.client.0.smithi084.stdout: create 152/39 file after the snapshot 2024-04-14T11:00:22.367 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/.snap/snap-subdir-test 2024-04-14T11:00:22.381 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/30 file after the snapshot 2024-04-14T11:00:22.382 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/31 file after the snapshot 2024-04-14T11:00:22.384 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/32 file after the snapshot 2024-04-14T11:00:22.385 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/33 file after the snapshot 2024-04-14T11:00:22.387 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/34 file after the snapshot 2024-04-14T11:00:22.389 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/35 file after the snapshot 2024-04-14T11:00:22.390 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/36 file after the snapshot 2024-04-14T11:00:22.392 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/37 file after the snapshot 2024-04-14T11:00:22.394 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/38 file after the snapshot 2024-04-14T11:00:22.395 INFO:tasks.workunit.client.0.smithi084.stdout: create 153/39 file after the snapshot 2024-04-14T11:00:22.397 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/.snap/snap-subdir-test 2024-04-14T11:00:22.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/30 file after the snapshot 2024-04-14T11:00:22.412 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/31 file after the snapshot 2024-04-14T11:00:22.414 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/32 file after the snapshot 2024-04-14T11:00:22.416 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/33 file after the snapshot 2024-04-14T11:00:22.417 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/34 file after the snapshot 2024-04-14T11:00:22.419 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/35 file after the snapshot 2024-04-14T11:00:22.421 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/36 file after the snapshot 2024-04-14T11:00:22.422 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/37 file after the snapshot 2024-04-14T11:00:22.424 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/38 file after the snapshot 2024-04-14T11:00:22.425 INFO:tasks.workunit.client.0.smithi084.stdout: create 154/39 file after the snapshot 2024-04-14T11:00:22.427 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/.snap/snap-subdir-test 2024-04-14T11:00:22.438 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/30 file after the snapshot 2024-04-14T11:00:22.439 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/31 file after the snapshot 2024-04-14T11:00:22.441 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/32 file after the snapshot 2024-04-14T11:00:22.443 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/33 file after the snapshot 2024-04-14T11:00:22.444 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/34 file after the snapshot 2024-04-14T11:00:22.446 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/35 file after the snapshot 2024-04-14T11:00:22.447 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/36 file after the snapshot 2024-04-14T11:00:22.449 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/37 file after the snapshot 2024-04-14T11:00:22.451 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/38 file after the snapshot 2024-04-14T11:00:22.452 INFO:tasks.workunit.client.0.smithi084.stdout: create 155/39 file after the snapshot 2024-04-14T11:00:22.454 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/.snap/snap-subdir-test 2024-04-14T11:00:22.465 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/30 file after the snapshot 2024-04-14T11:00:22.467 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/31 file after the snapshot 2024-04-14T11:00:22.469 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/32 file after the snapshot 2024-04-14T11:00:22.471 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/33 file after the snapshot 2024-04-14T11:00:22.472 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/34 file after the snapshot 2024-04-14T11:00:22.474 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/35 file after the snapshot 2024-04-14T11:00:22.476 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/36 file after the snapshot 2024-04-14T11:00:22.478 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/37 file after the snapshot 2024-04-14T11:00:22.479 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/38 file after the snapshot 2024-04-14T11:00:22.481 INFO:tasks.workunit.client.0.smithi084.stdout: create 156/39 file after the snapshot 2024-04-14T11:00:22.482 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/.snap/snap-subdir-test 2024-04-14T11:00:22.494 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/30 file after the snapshot 2024-04-14T11:00:22.495 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/31 file after the snapshot 2024-04-14T11:00:22.497 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/32 file after the snapshot 2024-04-14T11:00:22.499 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/33 file after the snapshot 2024-04-14T11:00:22.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/34 file after the snapshot 2024-04-14T11:00:22.502 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/35 file after the snapshot 2024-04-14T11:00:22.504 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/36 file after the snapshot 2024-04-14T11:00:22.505 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/37 file after the snapshot 2024-04-14T11:00:22.507 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/38 file after the snapshot 2024-04-14T11:00:22.509 INFO:tasks.workunit.client.0.smithi084.stdout: create 157/39 file after the snapshot 2024-04-14T11:00:22.511 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/.snap/snap-subdir-test 2024-04-14T11:00:22.523 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/30 file after the snapshot 2024-04-14T11:00:22.525 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/31 file after the snapshot 2024-04-14T11:00:22.527 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/32 file after the snapshot 2024-04-14T11:00:22.529 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/33 file after the snapshot 2024-04-14T11:00:22.530 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/34 file after the snapshot 2024-04-14T11:00:22.532 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/35 file after the snapshot 2024-04-14T11:00:22.535 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/36 file after the snapshot 2024-04-14T11:00:22.536 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/37 file after the snapshot 2024-04-14T11:00:22.538 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/38 file after the snapshot 2024-04-14T11:00:22.539 INFO:tasks.workunit.client.0.smithi084.stdout: create 158/39 file after the snapshot 2024-04-14T11:00:22.541 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/.snap/snap-subdir-test 2024-04-14T11:00:22.552 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/30 file after the snapshot 2024-04-14T11:00:22.553 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/31 file after the snapshot 2024-04-14T11:00:22.555 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/32 file after the snapshot 2024-04-14T11:00:22.557 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/33 file after the snapshot 2024-04-14T11:00:22.559 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/34 file after the snapshot 2024-04-14T11:00:22.562 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/35 file after the snapshot 2024-04-14T11:00:22.562 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/36 file after the snapshot 2024-04-14T11:00:22.564 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/37 file after the snapshot 2024-04-14T11:00:22.565 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/38 file after the snapshot 2024-04-14T11:00:22.567 INFO:tasks.workunit.client.0.smithi084.stdout: create 159/39 file after the snapshot 2024-04-14T11:00:22.568 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/.snap/snap-subdir-test 2024-04-14T11:00:22.582 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/30 file after the snapshot 2024-04-14T11:00:22.583 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/31 file after the snapshot 2024-04-14T11:00:22.585 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/32 file after the snapshot 2024-04-14T11:00:22.587 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/33 file after the snapshot 2024-04-14T11:00:22.588 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/34 file after the snapshot 2024-04-14T11:00:22.590 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/35 file after the snapshot 2024-04-14T11:00:22.591 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/36 file after the snapshot 2024-04-14T11:00:22.593 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/37 file after the snapshot 2024-04-14T11:00:22.595 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/38 file after the snapshot 2024-04-14T11:00:22.596 INFO:tasks.workunit.client.0.smithi084.stdout: create 160/39 file after the snapshot 2024-04-14T11:00:22.598 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/.snap/snap-subdir-test 2024-04-14T11:00:22.611 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/30 file after the snapshot 2024-04-14T11:00:22.612 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/31 file after the snapshot 2024-04-14T11:00:22.614 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/32 file after the snapshot 2024-04-14T11:00:22.616 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/33 file after the snapshot 2024-04-14T11:00:22.617 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/34 file after the snapshot 2024-04-14T11:00:22.619 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/35 file after the snapshot 2024-04-14T11:00:22.621 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/36 file after the snapshot 2024-04-14T11:00:22.622 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/37 file after the snapshot 2024-04-14T11:00:22.624 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/38 file after the snapshot 2024-04-14T11:00:22.625 INFO:tasks.workunit.client.0.smithi084.stdout: create 161/39 file after the snapshot 2024-04-14T11:00:22.627 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/.snap/snap-subdir-test 2024-04-14T11:00:22.639 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/30 file after the snapshot 2024-04-14T11:00:22.641 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/31 file after the snapshot 2024-04-14T11:00:22.643 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/32 file after the snapshot 2024-04-14T11:00:22.644 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/33 file after the snapshot 2024-04-14T11:00:22.646 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/34 file after the snapshot 2024-04-14T11:00:22.647 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/35 file after the snapshot 2024-04-14T11:00:22.649 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/36 file after the snapshot 2024-04-14T11:00:22.651 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/37 file after the snapshot 2024-04-14T11:00:22.652 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/38 file after the snapshot 2024-04-14T11:00:22.654 INFO:tasks.workunit.client.0.smithi084.stdout: create 162/39 file after the snapshot 2024-04-14T11:00:22.656 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/.snap/snap-subdir-test 2024-04-14T11:00:22.667 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/30 file after the snapshot 2024-04-14T11:00:22.669 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/31 file after the snapshot 2024-04-14T11:00:22.670 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/32 file after the snapshot 2024-04-14T11:00:22.672 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/33 file after the snapshot 2024-04-14T11:00:22.674 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/34 file after the snapshot 2024-04-14T11:00:22.675 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/35 file after the snapshot 2024-04-14T11:00:22.677 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/36 file after the snapshot 2024-04-14T11:00:22.678 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/37 file after the snapshot 2024-04-14T11:00:22.680 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/38 file after the snapshot 2024-04-14T11:00:22.682 INFO:tasks.workunit.client.0.smithi084.stdout: create 163/39 file after the snapshot 2024-04-14T11:00:22.684 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/.snap/snap-subdir-test 2024-04-14T11:00:22.696 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/30 file after the snapshot 2024-04-14T11:00:22.697 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/31 file after the snapshot 2024-04-14T11:00:22.699 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/32 file after the snapshot 2024-04-14T11:00:22.701 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/33 file after the snapshot 2024-04-14T11:00:22.703 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/34 file after the snapshot 2024-04-14T11:00:22.704 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/35 file after the snapshot 2024-04-14T11:00:22.706 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/36 file after the snapshot 2024-04-14T11:00:22.707 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/37 file after the snapshot 2024-04-14T11:00:22.709 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/38 file after the snapshot 2024-04-14T11:00:22.711 INFO:tasks.workunit.client.0.smithi084.stdout: create 164/39 file after the snapshot 2024-04-14T11:00:22.712 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/.snap/snap-subdir-test 2024-04-14T11:00:22.723 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/30 file after the snapshot 2024-04-14T11:00:22.725 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/31 file after the snapshot 2024-04-14T11:00:22.726 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/32 file after the snapshot 2024-04-14T11:00:22.728 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/33 file after the snapshot 2024-04-14T11:00:22.743 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/34 file after the snapshot 2024-04-14T11:00:22.820 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/35 file after the snapshot 2024-04-14T11:00:22.821 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/36 file after the snapshot 2024-04-14T11:00:22.823 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/37 file after the snapshot 2024-04-14T11:00:22.825 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/38 file after the snapshot 2024-04-14T11:00:22.827 INFO:tasks.workunit.client.0.smithi084.stdout: create 165/39 file after the snapshot 2024-04-14T11:00:22.828 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/.snap/snap-subdir-test 2024-04-14T11:00:22.882 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/30 file after the snapshot 2024-04-14T11:00:22.884 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/31 file after the snapshot 2024-04-14T11:00:22.885 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/32 file after the snapshot 2024-04-14T11:00:22.887 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/33 file after the snapshot 2024-04-14T11:00:22.889 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/34 file after the snapshot 2024-04-14T11:00:22.890 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/35 file after the snapshot 2024-04-14T11:00:22.892 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/36 file after the snapshot 2024-04-14T11:00:22.894 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/37 file after the snapshot 2024-04-14T11:00:22.895 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/38 file after the snapshot 2024-04-14T11:00:22.897 INFO:tasks.workunit.client.0.smithi084.stdout: create 166/39 file after the snapshot 2024-04-14T11:00:22.899 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/.snap/snap-subdir-test 2024-04-14T11:00:22.912 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/30 file after the snapshot 2024-04-14T11:00:22.913 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/31 file after the snapshot 2024-04-14T11:00:22.915 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/32 file after the snapshot 2024-04-14T11:00:22.916 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/33 file after the snapshot 2024-04-14T11:00:22.918 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/34 file after the snapshot 2024-04-14T11:00:22.920 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/35 file after the snapshot 2024-04-14T11:00:22.922 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/36 file after the snapshot 2024-04-14T11:00:22.924 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/37 file after the snapshot 2024-04-14T11:00:22.925 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/38 file after the snapshot 2024-04-14T11:00:22.927 INFO:tasks.workunit.client.0.smithi084.stdout: create 167/39 file after the snapshot 2024-04-14T11:00:22.928 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/.snap/snap-subdir-test 2024-04-14T11:00:22.940 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/30 file after the snapshot 2024-04-14T11:00:22.942 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/31 file after the snapshot 2024-04-14T11:00:22.943 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/32 file after the snapshot 2024-04-14T11:00:22.945 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/33 file after the snapshot 2024-04-14T11:00:22.946 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/34 file after the snapshot 2024-04-14T11:00:22.948 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/35 file after the snapshot 2024-04-14T11:00:22.950 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/36 file after the snapshot 2024-04-14T11:00:22.952 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/37 file after the snapshot 2024-04-14T11:00:22.953 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/38 file after the snapshot 2024-04-14T11:00:22.955 INFO:tasks.workunit.client.0.smithi084.stdout: create 168/39 file after the snapshot 2024-04-14T11:00:22.956 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/.snap/snap-subdir-test 2024-04-14T11:00:22.970 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/30 file after the snapshot 2024-04-14T11:00:22.970 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/31 file after the snapshot 2024-04-14T11:00:22.971 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/32 file after the snapshot 2024-04-14T11:00:22.972 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/33 file after the snapshot 2024-04-14T11:00:22.974 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/34 file after the snapshot 2024-04-14T11:00:22.976 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/35 file after the snapshot 2024-04-14T11:00:22.978 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/36 file after the snapshot 2024-04-14T11:00:22.979 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/37 file after the snapshot 2024-04-14T11:00:22.981 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/38 file after the snapshot 2024-04-14T11:00:22.982 INFO:tasks.workunit.client.0.smithi084.stdout: create 169/39 file after the snapshot 2024-04-14T11:00:22.984 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/.snap/snap-subdir-test 2024-04-14T11:00:22.996 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/30 file after the snapshot 2024-04-14T11:00:22.998 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/31 file after the snapshot 2024-04-14T11:00:22.999 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/32 file after the snapshot 2024-04-14T11:00:23.001 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/33 file after the snapshot 2024-04-14T11:00:23.003 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/34 file after the snapshot 2024-04-14T11:00:23.004 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/35 file after the snapshot 2024-04-14T11:00:23.006 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/36 file after the snapshot 2024-04-14T11:00:23.008 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/37 file after the snapshot 2024-04-14T11:00:23.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/38 file after the snapshot 2024-04-14T11:00:23.011 INFO:tasks.workunit.client.0.smithi084.stdout: create 170/39 file after the snapshot 2024-04-14T11:00:23.013 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/.snap/snap-subdir-test 2024-04-14T11:00:23.025 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/30 file after the snapshot 2024-04-14T11:00:23.027 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/31 file after the snapshot 2024-04-14T11:00:23.028 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/32 file after the snapshot 2024-04-14T11:00:23.030 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/33 file after the snapshot 2024-04-14T11:00:23.032 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/34 file after the snapshot 2024-04-14T11:00:23.034 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/35 file after the snapshot 2024-04-14T11:00:23.035 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/36 file after the snapshot 2024-04-14T11:00:23.037 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/37 file after the snapshot 2024-04-14T11:00:23.039 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/38 file after the snapshot 2024-04-14T11:00:23.040 INFO:tasks.workunit.client.0.smithi084.stdout: create 171/39 file after the snapshot 2024-04-14T11:00:23.042 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/.snap/snap-subdir-test 2024-04-14T11:00:23.053 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/30 file after the snapshot 2024-04-14T11:00:23.055 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/31 file after the snapshot 2024-04-14T11:00:23.056 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/32 file after the snapshot 2024-04-14T11:00:23.058 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/33 file after the snapshot 2024-04-14T11:00:23.059 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/34 file after the snapshot 2024-04-14T11:00:23.061 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/35 file after the snapshot 2024-04-14T11:00:23.063 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/36 file after the snapshot 2024-04-14T11:00:23.064 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/37 file after the snapshot 2024-04-14T11:00:23.066 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/38 file after the snapshot 2024-04-14T11:00:23.067 INFO:tasks.workunit.client.0.smithi084.stdout: create 172/39 file after the snapshot 2024-04-14T11:00:23.069 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/.snap/snap-subdir-test 2024-04-14T11:00:23.081 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/30 file after the snapshot 2024-04-14T11:00:23.082 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/31 file after the snapshot 2024-04-14T11:00:23.085 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/32 file after the snapshot 2024-04-14T11:00:23.086 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/33 file after the snapshot 2024-04-14T11:00:23.088 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/34 file after the snapshot 2024-04-14T11:00:23.090 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/35 file after the snapshot 2024-04-14T11:00:23.092 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/36 file after the snapshot 2024-04-14T11:00:23.094 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/37 file after the snapshot 2024-04-14T11:00:23.095 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/38 file after the snapshot 2024-04-14T11:00:23.097 INFO:tasks.workunit.client.0.smithi084.stdout: create 173/39 file after the snapshot 2024-04-14T11:00:23.099 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/.snap/snap-subdir-test 2024-04-14T11:00:23.111 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/30 file after the snapshot 2024-04-14T11:00:23.112 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/31 file after the snapshot 2024-04-14T11:00:23.114 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/32 file after the snapshot 2024-04-14T11:00:23.116 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/33 file after the snapshot 2024-04-14T11:00:23.117 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/34 file after the snapshot 2024-04-14T11:00:23.119 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/35 file after the snapshot 2024-04-14T11:00:23.121 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/36 file after the snapshot 2024-04-14T11:00:23.122 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/37 file after the snapshot 2024-04-14T11:00:23.124 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/38 file after the snapshot 2024-04-14T11:00:23.126 INFO:tasks.workunit.client.0.smithi084.stdout: create 174/39 file after the snapshot 2024-04-14T11:00:23.127 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/.snap/snap-subdir-test 2024-04-14T11:00:23.140 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/30 file after the snapshot 2024-04-14T11:00:23.141 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/31 file after the snapshot 2024-04-14T11:00:23.142 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/32 file after the snapshot 2024-04-14T11:00:23.144 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/33 file after the snapshot 2024-04-14T11:00:23.146 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/34 file after the snapshot 2024-04-14T11:00:23.148 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/35 file after the snapshot 2024-04-14T11:00:23.150 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/36 file after the snapshot 2024-04-14T11:00:23.152 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/37 file after the snapshot 2024-04-14T11:00:23.153 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/38 file after the snapshot 2024-04-14T11:00:23.155 INFO:tasks.workunit.client.0.smithi084.stdout: create 175/39 file after the snapshot 2024-04-14T11:00:23.157 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/.snap/snap-subdir-test 2024-04-14T11:00:23.169 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/30 file after the snapshot 2024-04-14T11:00:23.170 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/31 file after the snapshot 2024-04-14T11:00:23.173 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/32 file after the snapshot 2024-04-14T11:00:23.173 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/33 file after the snapshot 2024-04-14T11:00:23.175 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/34 file after the snapshot 2024-04-14T11:00:23.177 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/35 file after the snapshot 2024-04-14T11:00:23.179 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/36 file after the snapshot 2024-04-14T11:00:23.180 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/37 file after the snapshot 2024-04-14T11:00:23.182 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/38 file after the snapshot 2024-04-14T11:00:23.184 INFO:tasks.workunit.client.0.smithi084.stdout: create 176/39 file after the snapshot 2024-04-14T11:00:23.185 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/.snap/snap-subdir-test 2024-04-14T11:00:23.199 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/30 file after the snapshot 2024-04-14T11:00:23.200 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/31 file after the snapshot 2024-04-14T11:00:23.202 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/32 file after the snapshot 2024-04-14T11:00:23.204 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/33 file after the snapshot 2024-04-14T11:00:23.206 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/34 file after the snapshot 2024-04-14T11:00:23.207 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/35 file after the snapshot 2024-04-14T11:00:23.209 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/36 file after the snapshot 2024-04-14T11:00:23.210 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/37 file after the snapshot 2024-04-14T11:00:23.212 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/38 file after the snapshot 2024-04-14T11:00:23.213 INFO:tasks.workunit.client.0.smithi084.stdout: create 177/39 file after the snapshot 2024-04-14T11:00:23.215 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/.snap/snap-subdir-test 2024-04-14T11:00:23.228 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/30 file after the snapshot 2024-04-14T11:00:23.229 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/31 file after the snapshot 2024-04-14T11:00:23.231 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/32 file after the snapshot 2024-04-14T11:00:23.232 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/33 file after the snapshot 2024-04-14T11:00:23.234 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/34 file after the snapshot 2024-04-14T11:00:23.235 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/35 file after the snapshot 2024-04-14T11:00:23.237 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/36 file after the snapshot 2024-04-14T11:00:23.239 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/37 file after the snapshot 2024-04-14T11:00:23.241 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/38 file after the snapshot 2024-04-14T11:00:23.243 INFO:tasks.workunit.client.0.smithi084.stdout: create 178/39 file after the snapshot 2024-04-14T11:00:23.245 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/.snap/snap-subdir-test 2024-04-14T11:00:23.259 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/30 file after the snapshot 2024-04-14T11:00:23.261 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/31 file after the snapshot 2024-04-14T11:00:23.262 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/32 file after the snapshot 2024-04-14T11:00:23.264 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/33 file after the snapshot 2024-04-14T11:00:23.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/34 file after the snapshot 2024-04-14T11:00:23.267 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/35 file after the snapshot 2024-04-14T11:00:23.269 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/36 file after the snapshot 2024-04-14T11:00:23.270 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/37 file after the snapshot 2024-04-14T11:00:23.272 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/38 file after the snapshot 2024-04-14T11:00:23.273 INFO:tasks.workunit.client.0.smithi084.stdout: create 179/39 file after the snapshot 2024-04-14T11:00:23.275 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/.snap/snap-subdir-test 2024-04-14T11:00:23.287 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/30 file after the snapshot 2024-04-14T11:00:23.289 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/31 file after the snapshot 2024-04-14T11:00:23.291 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/32 file after the snapshot 2024-04-14T11:00:23.292 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/33 file after the snapshot 2024-04-14T11:00:23.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/34 file after the snapshot 2024-04-14T11:00:23.295 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/35 file after the snapshot 2024-04-14T11:00:23.297 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/36 file after the snapshot 2024-04-14T11:00:23.298 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/37 file after the snapshot 2024-04-14T11:00:23.300 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/38 file after the snapshot 2024-04-14T11:00:23.302 INFO:tasks.workunit.client.0.smithi084.stdout: create 180/39 file after the snapshot 2024-04-14T11:00:23.303 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/.snap/snap-subdir-test 2024-04-14T11:00:23.315 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/30 file after the snapshot 2024-04-14T11:00:23.316 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/31 file after the snapshot 2024-04-14T11:00:23.318 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/32 file after the snapshot 2024-04-14T11:00:23.319 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/33 file after the snapshot 2024-04-14T11:00:23.321 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/34 file after the snapshot 2024-04-14T11:00:23.323 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/35 file after the snapshot 2024-04-14T11:00:23.324 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/36 file after the snapshot 2024-04-14T11:00:23.326 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/37 file after the snapshot 2024-04-14T11:00:23.327 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/38 file after the snapshot 2024-04-14T11:00:23.329 INFO:tasks.workunit.client.0.smithi084.stdout: create 181/39 file after the snapshot 2024-04-14T11:00:23.331 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/.snap/snap-subdir-test 2024-04-14T11:00:23.342 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/30 file after the snapshot 2024-04-14T11:00:23.343 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/31 file after the snapshot 2024-04-14T11:00:23.345 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/32 file after the snapshot 2024-04-14T11:00:23.347 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/33 file after the snapshot 2024-04-14T11:00:23.348 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/34 file after the snapshot 2024-04-14T11:00:23.350 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/35 file after the snapshot 2024-04-14T11:00:23.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/36 file after the snapshot 2024-04-14T11:00:23.353 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/37 file after the snapshot 2024-04-14T11:00:23.355 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/38 file after the snapshot 2024-04-14T11:00:23.357 INFO:tasks.workunit.client.0.smithi084.stdout: create 182/39 file after the snapshot 2024-04-14T11:00:23.358 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/.snap/snap-subdir-test 2024-04-14T11:00:23.370 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/30 file after the snapshot 2024-04-14T11:00:23.371 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/31 file after the snapshot 2024-04-14T11:00:23.373 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/32 file after the snapshot 2024-04-14T11:00:23.375 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/33 file after the snapshot 2024-04-14T11:00:23.377 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/34 file after the snapshot 2024-04-14T11:00:23.378 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/35 file after the snapshot 2024-04-14T11:00:23.380 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/36 file after the snapshot 2024-04-14T11:00:23.381 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/37 file after the snapshot 2024-04-14T11:00:23.383 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/38 file after the snapshot 2024-04-14T11:00:23.385 INFO:tasks.workunit.client.0.smithi084.stdout: create 183/39 file after the snapshot 2024-04-14T11:00:23.386 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/.snap/snap-subdir-test 2024-04-14T11:00:23.397 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/30 file after the snapshot 2024-04-14T11:00:23.399 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/31 file after the snapshot 2024-04-14T11:00:23.401 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/32 file after the snapshot 2024-04-14T11:00:23.402 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/33 file after the snapshot 2024-04-14T11:00:23.404 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/34 file after the snapshot 2024-04-14T11:00:23.406 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/35 file after the snapshot 2024-04-14T11:00:23.407 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/36 file after the snapshot 2024-04-14T11:00:23.409 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/37 file after the snapshot 2024-04-14T11:00:23.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/38 file after the snapshot 2024-04-14T11:00:23.413 INFO:tasks.workunit.client.0.smithi084.stdout: create 184/39 file after the snapshot 2024-04-14T11:00:23.415 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/.snap/snap-subdir-test 2024-04-14T11:00:23.427 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/30 file after the snapshot 2024-04-14T11:00:23.428 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/31 file after the snapshot 2024-04-14T11:00:23.430 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/32 file after the snapshot 2024-04-14T11:00:23.432 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/33 file after the snapshot 2024-04-14T11:00:23.433 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/34 file after the snapshot 2024-04-14T11:00:23.435 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/35 file after the snapshot 2024-04-14T11:00:23.437 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/36 file after the snapshot 2024-04-14T11:00:23.438 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/37 file after the snapshot 2024-04-14T11:00:23.440 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/38 file after the snapshot 2024-04-14T11:00:23.441 INFO:tasks.workunit.client.0.smithi084.stdout: create 185/39 file after the snapshot 2024-04-14T11:00:23.443 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/.snap/snap-subdir-test 2024-04-14T11:00:23.455 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/30 file after the snapshot 2024-04-14T11:00:23.456 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/31 file after the snapshot 2024-04-14T11:00:23.458 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/32 file after the snapshot 2024-04-14T11:00:23.460 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/33 file after the snapshot 2024-04-14T11:00:23.461 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/34 file after the snapshot 2024-04-14T11:00:23.463 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/35 file after the snapshot 2024-04-14T11:00:23.465 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/36 file after the snapshot 2024-04-14T11:00:23.466 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/37 file after the snapshot 2024-04-14T11:00:23.468 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/38 file after the snapshot 2024-04-14T11:00:23.470 INFO:tasks.workunit.client.0.smithi084.stdout: create 186/39 file after the snapshot 2024-04-14T11:00:23.471 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/.snap/snap-subdir-test 2024-04-14T11:00:23.483 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/30 file after the snapshot 2024-04-14T11:00:23.485 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/31 file after the snapshot 2024-04-14T11:00:23.487 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/32 file after the snapshot 2024-04-14T11:00:23.490 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/33 file after the snapshot 2024-04-14T11:00:23.491 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/34 file after the snapshot 2024-04-14T11:00:23.492 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/35 file after the snapshot 2024-04-14T11:00:23.493 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/36 file after the snapshot 2024-04-14T11:00:23.495 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/37 file after the snapshot 2024-04-14T11:00:23.496 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/38 file after the snapshot 2024-04-14T11:00:23.498 INFO:tasks.workunit.client.0.smithi084.stdout: create 187/39 file after the snapshot 2024-04-14T11:00:23.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/.snap/snap-subdir-test 2024-04-14T11:00:23.511 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/30 file after the snapshot 2024-04-14T11:00:23.512 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/31 file after the snapshot 2024-04-14T11:00:23.514 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/32 file after the snapshot 2024-04-14T11:00:23.516 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/33 file after the snapshot 2024-04-14T11:00:23.517 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/34 file after the snapshot 2024-04-14T11:00:23.519 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/35 file after the snapshot 2024-04-14T11:00:23.521 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/36 file after the snapshot 2024-04-14T11:00:23.522 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/37 file after the snapshot 2024-04-14T11:00:23.524 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/38 file after the snapshot 2024-04-14T11:00:23.525 INFO:tasks.workunit.client.0.smithi084.stdout: create 188/39 file after the snapshot 2024-04-14T11:00:23.527 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/.snap/snap-subdir-test 2024-04-14T11:00:23.539 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/30 file after the snapshot 2024-04-14T11:00:23.541 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/31 file after the snapshot 2024-04-14T11:00:23.542 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/32 file after the snapshot 2024-04-14T11:00:23.544 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/33 file after the snapshot 2024-04-14T11:00:23.546 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/34 file after the snapshot 2024-04-14T11:00:23.548 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/35 file after the snapshot 2024-04-14T11:00:23.549 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/36 file after the snapshot 2024-04-14T11:00:23.551 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/37 file after the snapshot 2024-04-14T11:00:23.552 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/38 file after the snapshot 2024-04-14T11:00:23.554 INFO:tasks.workunit.client.0.smithi084.stdout: create 189/39 file after the snapshot 2024-04-14T11:00:23.555 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/.snap/snap-subdir-test 2024-04-14T11:00:23.566 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/30 file after the snapshot 2024-04-14T11:00:23.568 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/31 file after the snapshot 2024-04-14T11:00:23.569 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/32 file after the snapshot 2024-04-14T11:00:23.571 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/33 file after the snapshot 2024-04-14T11:00:23.573 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/34 file after the snapshot 2024-04-14T11:00:23.575 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/35 file after the snapshot 2024-04-14T11:00:23.577 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/36 file after the snapshot 2024-04-14T11:00:23.578 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/37 file after the snapshot 2024-04-14T11:00:23.580 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/38 file after the snapshot 2024-04-14T11:00:23.583 INFO:tasks.workunit.client.0.smithi084.stdout: create 190/39 file after the snapshot 2024-04-14T11:00:23.584 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/.snap/snap-subdir-test 2024-04-14T11:00:23.596 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/30 file after the snapshot 2024-04-14T11:00:23.597 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/31 file after the snapshot 2024-04-14T11:00:23.599 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/32 file after the snapshot 2024-04-14T11:00:23.600 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/33 file after the snapshot 2024-04-14T11:00:23.602 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/34 file after the snapshot 2024-04-14T11:00:23.604 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/35 file after the snapshot 2024-04-14T11:00:23.605 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/36 file after the snapshot 2024-04-14T11:00:23.607 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/37 file after the snapshot 2024-04-14T11:00:23.609 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/38 file after the snapshot 2024-04-14T11:00:23.610 INFO:tasks.workunit.client.0.smithi084.stdout: create 191/39 file after the snapshot 2024-04-14T11:00:23.612 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/.snap/snap-subdir-test 2024-04-14T11:00:23.623 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/30 file after the snapshot 2024-04-14T11:00:23.624 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/31 file after the snapshot 2024-04-14T11:00:23.626 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/32 file after the snapshot 2024-04-14T11:00:23.628 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/33 file after the snapshot 2024-04-14T11:00:23.629 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/34 file after the snapshot 2024-04-14T11:00:23.631 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/35 file after the snapshot 2024-04-14T11:00:23.633 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/36 file after the snapshot 2024-04-14T11:00:23.634 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/37 file after the snapshot 2024-04-14T11:00:23.636 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/38 file after the snapshot 2024-04-14T11:00:23.638 INFO:tasks.workunit.client.0.smithi084.stdout: create 192/39 file after the snapshot 2024-04-14T11:00:23.639 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/.snap/snap-subdir-test 2024-04-14T11:00:23.651 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/30 file after the snapshot 2024-04-14T11:00:23.652 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/31 file after the snapshot 2024-04-14T11:00:23.654 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/32 file after the snapshot 2024-04-14T11:00:23.655 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/33 file after the snapshot 2024-04-14T11:00:23.657 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/34 file after the snapshot 2024-04-14T11:00:23.660 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/35 file after the snapshot 2024-04-14T11:00:23.662 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/36 file after the snapshot 2024-04-14T11:00:23.663 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/37 file after the snapshot 2024-04-14T11:00:23.665 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/38 file after the snapshot 2024-04-14T11:00:23.667 INFO:tasks.workunit.client.0.smithi084.stdout: create 193/39 file after the snapshot 2024-04-14T11:00:23.669 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/.snap/snap-subdir-test 2024-04-14T11:00:23.681 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/30 file after the snapshot 2024-04-14T11:00:23.682 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/31 file after the snapshot 2024-04-14T11:00:23.684 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/32 file after the snapshot 2024-04-14T11:00:23.685 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/33 file after the snapshot 2024-04-14T11:00:23.687 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/34 file after the snapshot 2024-04-14T11:00:23.689 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/35 file after the snapshot 2024-04-14T11:00:23.690 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/36 file after the snapshot 2024-04-14T11:00:23.692 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/37 file after the snapshot 2024-04-14T11:00:23.693 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/38 file after the snapshot 2024-04-14T11:00:23.695 INFO:tasks.workunit.client.0.smithi084.stdout: create 194/39 file after the snapshot 2024-04-14T11:00:23.696 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/.snap/snap-subdir-test 2024-04-14T11:00:23.710 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/30 file after the snapshot 2024-04-14T11:00:23.712 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/31 file after the snapshot 2024-04-14T11:00:23.713 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/32 file after the snapshot 2024-04-14T11:00:23.715 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/33 file after the snapshot 2024-04-14T11:00:23.716 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/34 file after the snapshot 2024-04-14T11:00:23.718 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/35 file after the snapshot 2024-04-14T11:00:23.720 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/36 file after the snapshot 2024-04-14T11:00:23.721 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/37 file after the snapshot 2024-04-14T11:00:23.723 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/38 file after the snapshot 2024-04-14T11:00:23.724 INFO:tasks.workunit.client.0.smithi084.stdout: create 195/39 file after the snapshot 2024-04-14T11:00:23.726 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/.snap/snap-subdir-test 2024-04-14T11:00:23.738 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/30 file after the snapshot 2024-04-14T11:00:23.739 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/31 file after the snapshot 2024-04-14T11:00:23.742 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/32 file after the snapshot 2024-04-14T11:00:23.760 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/33 file after the snapshot 2024-04-14T11:00:23.886 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/34 file after the snapshot 2024-04-14T11:00:23.887 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/35 file after the snapshot 2024-04-14T11:00:23.889 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/36 file after the snapshot 2024-04-14T11:00:23.891 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/37 file after the snapshot 2024-04-14T11:00:23.893 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/38 file after the snapshot 2024-04-14T11:00:23.894 INFO:tasks.workunit.client.0.smithi084.stdout: create 196/39 file after the snapshot 2024-04-14T11:00:23.896 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/.snap/snap-subdir-test 2024-04-14T11:00:23.973 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/30 file after the snapshot 2024-04-14T11:00:23.974 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/31 file after the snapshot 2024-04-14T11:00:23.976 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/32 file after the snapshot 2024-04-14T11:00:23.977 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/33 file after the snapshot 2024-04-14T11:00:23.979 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/34 file after the snapshot 2024-04-14T11:00:23.980 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/35 file after the snapshot 2024-04-14T11:00:23.982 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/36 file after the snapshot 2024-04-14T11:00:23.984 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/37 file after the snapshot 2024-04-14T11:00:23.985 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/38 file after the snapshot 2024-04-14T11:00:23.987 INFO:tasks.workunit.client.0.smithi084.stdout: create 197/39 file after the snapshot 2024-04-14T11:00:23.989 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/.snap/snap-subdir-test 2024-04-14T11:00:24.000 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/30 file after the snapshot 2024-04-14T11:00:24.002 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/31 file after the snapshot 2024-04-14T11:00:24.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/32 file after the snapshot 2024-04-14T11:00:24.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/33 file after the snapshot 2024-04-14T11:00:24.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/34 file after the snapshot 2024-04-14T11:00:24.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/35 file after the snapshot 2024-04-14T11:00:24.011 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/36 file after the snapshot 2024-04-14T11:00:24.012 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/37 file after the snapshot 2024-04-14T11:00:24.014 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/38 file after the snapshot 2024-04-14T11:00:24.015 INFO:tasks.workunit.client.0.smithi084.stdout: create 198/39 file after the snapshot 2024-04-14T11:00:24.017 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/.snap/snap-subdir-test 2024-04-14T11:00:24.029 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/30 file after the snapshot 2024-04-14T11:00:24.030 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/31 file after the snapshot 2024-04-14T11:00:24.032 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/32 file after the snapshot 2024-04-14T11:00:24.035 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/33 file after the snapshot 2024-04-14T11:00:24.037 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/34 file after the snapshot 2024-04-14T11:00:24.039 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/35 file after the snapshot 2024-04-14T11:00:24.041 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/36 file after the snapshot 2024-04-14T11:00:24.043 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/37 file after the snapshot 2024-04-14T11:00:24.045 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/38 file after the snapshot 2024-04-14T11:00:24.046 INFO:tasks.workunit.client.0.smithi084.stdout: create 199/39 file after the snapshot 2024-04-14T11:00:24.049 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/.snap/snap-subdir-test 2024-04-14T11:00:24.064 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/30 file after the snapshot 2024-04-14T11:00:24.065 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/31 file after the snapshot 2024-04-14T11:00:24.067 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/32 file after the snapshot 2024-04-14T11:00:24.069 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/33 file after the snapshot 2024-04-14T11:00:24.070 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/34 file after the snapshot 2024-04-14T11:00:24.142 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/35 file after the snapshot 2024-04-14T11:00:24.145 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/36 file after the snapshot 2024-04-14T11:00:24.146 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/37 file after the snapshot 2024-04-14T11:00:24.148 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/38 file after the snapshot 2024-04-14T11:00:24.150 INFO:tasks.workunit.client.0.smithi084.stdout: create 200/39 file after the snapshot 2024-04-14T11:00:24.152 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/.snap/snap-subdir-test 2024-04-14T11:00:24.164 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/30 file after the snapshot 2024-04-14T11:00:24.165 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/31 file after the snapshot 2024-04-14T11:00:24.167 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/32 file after the snapshot 2024-04-14T11:00:24.169 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/33 file after the snapshot 2024-04-14T11:00:24.171 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/34 file after the snapshot 2024-04-14T11:00:24.172 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/35 file after the snapshot 2024-04-14T11:00:24.174 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/36 file after the snapshot 2024-04-14T11:00:24.176 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/37 file after the snapshot 2024-04-14T11:00:24.177 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/38 file after the snapshot 2024-04-14T11:00:24.179 INFO:tasks.workunit.client.0.smithi084.stdout: create 201/39 file after the snapshot 2024-04-14T11:00:24.180 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/.snap/snap-subdir-test 2024-04-14T11:00:24.192 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/30 file after the snapshot 2024-04-14T11:00:24.193 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/31 file after the snapshot 2024-04-14T11:00:24.198 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/32 file after the snapshot 2024-04-14T11:00:24.199 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/33 file after the snapshot 2024-04-14T11:00:24.199 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/34 file after the snapshot 2024-04-14T11:00:24.200 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/35 file after the snapshot 2024-04-14T11:00:24.202 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/36 file after the snapshot 2024-04-14T11:00:24.204 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/37 file after the snapshot 2024-04-14T11:00:24.205 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/38 file after the snapshot 2024-04-14T11:00:24.207 INFO:tasks.workunit.client.0.smithi084.stdout: create 202/39 file after the snapshot 2024-04-14T11:00:24.208 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/.snap/snap-subdir-test 2024-04-14T11:00:24.220 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/30 file after the snapshot 2024-04-14T11:00:24.224 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/31 file after the snapshot 2024-04-14T11:00:24.229 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/32 file after the snapshot 2024-04-14T11:00:24.231 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/33 file after the snapshot 2024-04-14T11:00:24.232 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/34 file after the snapshot 2024-04-14T11:00:24.234 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/35 file after the snapshot 2024-04-14T11:00:24.236 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/36 file after the snapshot 2024-04-14T11:00:24.238 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/37 file after the snapshot 2024-04-14T11:00:24.240 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/38 file after the snapshot 2024-04-14T11:00:24.241 INFO:tasks.workunit.client.0.smithi084.stdout: create 203/39 file after the snapshot 2024-04-14T11:00:24.243 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/.snap/snap-subdir-test 2024-04-14T11:00:24.256 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/30 file after the snapshot 2024-04-14T11:00:24.257 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/31 file after the snapshot 2024-04-14T11:00:24.259 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/32 file after the snapshot 2024-04-14T11:00:24.260 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/33 file after the snapshot 2024-04-14T11:00:24.262 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/34 file after the snapshot 2024-04-14T11:00:24.264 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/35 file after the snapshot 2024-04-14T11:00:24.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/36 file after the snapshot 2024-04-14T11:00:24.267 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/37 file after the snapshot 2024-04-14T11:00:24.269 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/38 file after the snapshot 2024-04-14T11:00:24.270 INFO:tasks.workunit.client.0.smithi084.stdout: create 204/39 file after the snapshot 2024-04-14T11:00:24.272 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/.snap/snap-subdir-test 2024-04-14T11:00:24.285 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/30 file after the snapshot 2024-04-14T11:00:24.286 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/31 file after the snapshot 2024-04-14T11:00:24.288 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/32 file after the snapshot 2024-04-14T11:00:24.290 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/33 file after the snapshot 2024-04-14T11:00:24.291 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/34 file after the snapshot 2024-04-14T11:00:24.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/35 file after the snapshot 2024-04-14T11:00:24.295 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/36 file after the snapshot 2024-04-14T11:00:24.296 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/37 file after the snapshot 2024-04-14T11:00:24.298 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/38 file after the snapshot 2024-04-14T11:00:24.300 INFO:tasks.workunit.client.0.smithi084.stdout: create 205/39 file after the snapshot 2024-04-14T11:00:24.302 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/.snap/snap-subdir-test 2024-04-14T11:00:24.315 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/30 file after the snapshot 2024-04-14T11:00:24.317 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/31 file after the snapshot 2024-04-14T11:00:24.319 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/32 file after the snapshot 2024-04-14T11:00:24.321 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/33 file after the snapshot 2024-04-14T11:00:24.322 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/34 file after the snapshot 2024-04-14T11:00:24.324 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/35 file after the snapshot 2024-04-14T11:00:24.326 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/36 file after the snapshot 2024-04-14T11:00:24.327 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/37 file after the snapshot 2024-04-14T11:00:24.329 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/38 file after the snapshot 2024-04-14T11:00:24.331 INFO:tasks.workunit.client.0.smithi084.stdout: create 206/39 file after the snapshot 2024-04-14T11:00:24.333 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/.snap/snap-subdir-test 2024-04-14T11:00:24.344 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/30 file after the snapshot 2024-04-14T11:00:24.346 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/31 file after the snapshot 2024-04-14T11:00:24.347 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/32 file after the snapshot 2024-04-14T11:00:24.349 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/33 file after the snapshot 2024-04-14T11:00:24.350 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/34 file after the snapshot 2024-04-14T11:00:24.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/35 file after the snapshot 2024-04-14T11:00:24.353 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/36 file after the snapshot 2024-04-14T11:00:24.355 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/37 file after the snapshot 2024-04-14T11:00:24.357 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/38 file after the snapshot 2024-04-14T11:00:24.359 INFO:tasks.workunit.client.0.smithi084.stdout: create 207/39 file after the snapshot 2024-04-14T11:00:24.361 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/.snap/snap-subdir-test 2024-04-14T11:00:24.374 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/30 file after the snapshot 2024-04-14T11:00:24.376 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/31 file after the snapshot 2024-04-14T11:00:24.378 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/32 file after the snapshot 2024-04-14T11:00:24.379 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/33 file after the snapshot 2024-04-14T11:00:24.381 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/34 file after the snapshot 2024-04-14T11:00:24.383 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/35 file after the snapshot 2024-04-14T11:00:24.384 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/36 file after the snapshot 2024-04-14T11:00:24.386 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/37 file after the snapshot 2024-04-14T11:00:24.388 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/38 file after the snapshot 2024-04-14T11:00:24.390 INFO:tasks.workunit.client.0.smithi084.stdout: create 208/39 file after the snapshot 2024-04-14T11:00:24.393 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/.snap/snap-subdir-test 2024-04-14T11:00:24.407 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/30 file after the snapshot 2024-04-14T11:00:24.408 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/31 file after the snapshot 2024-04-14T11:00:24.410 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/32 file after the snapshot 2024-04-14T11:00:24.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/33 file after the snapshot 2024-04-14T11:00:24.413 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/34 file after the snapshot 2024-04-14T11:00:24.415 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/35 file after the snapshot 2024-04-14T11:00:24.417 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/36 file after the snapshot 2024-04-14T11:00:24.419 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/37 file after the snapshot 2024-04-14T11:00:24.421 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/38 file after the snapshot 2024-04-14T11:00:24.422 INFO:tasks.workunit.client.0.smithi084.stdout: create 209/39 file after the snapshot 2024-04-14T11:00:24.424 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/.snap/snap-subdir-test 2024-04-14T11:00:24.436 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/30 file after the snapshot 2024-04-14T11:00:24.438 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/31 file after the snapshot 2024-04-14T11:00:24.440 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/32 file after the snapshot 2024-04-14T11:00:24.441 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/33 file after the snapshot 2024-04-14T11:00:24.443 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/34 file after the snapshot 2024-04-14T11:00:24.445 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/35 file after the snapshot 2024-04-14T11:00:24.446 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/36 file after the snapshot 2024-04-14T11:00:24.448 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/37 file after the snapshot 2024-04-14T11:00:24.450 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/38 file after the snapshot 2024-04-14T11:00:24.451 INFO:tasks.workunit.client.0.smithi084.stdout: create 210/39 file after the snapshot 2024-04-14T11:00:24.453 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/.snap/snap-subdir-test 2024-04-14T11:00:24.464 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/30 file after the snapshot 2024-04-14T11:00:24.466 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/31 file after the snapshot 2024-04-14T11:00:24.468 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/32 file after the snapshot 2024-04-14T11:00:24.469 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/33 file after the snapshot 2024-04-14T11:00:24.471 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/34 file after the snapshot 2024-04-14T11:00:24.472 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/35 file after the snapshot 2024-04-14T11:00:24.474 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/36 file after the snapshot 2024-04-14T11:00:24.476 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/37 file after the snapshot 2024-04-14T11:00:24.477 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/38 file after the snapshot 2024-04-14T11:00:24.479 INFO:tasks.workunit.client.0.smithi084.stdout: create 211/39 file after the snapshot 2024-04-14T11:00:24.481 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/.snap/snap-subdir-test 2024-04-14T11:00:24.493 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/30 file after the snapshot 2024-04-14T11:00:24.495 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/31 file after the snapshot 2024-04-14T11:00:24.496 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/32 file after the snapshot 2024-04-14T11:00:24.498 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/33 file after the snapshot 2024-04-14T11:00:24.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/34 file after the snapshot 2024-04-14T11:00:24.502 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/35 file after the snapshot 2024-04-14T11:00:24.504 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/36 file after the snapshot 2024-04-14T11:00:24.505 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/37 file after the snapshot 2024-04-14T11:00:24.507 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/38 file after the snapshot 2024-04-14T11:00:24.508 INFO:tasks.workunit.client.0.smithi084.stdout: create 212/39 file after the snapshot 2024-04-14T11:00:24.510 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/.snap/snap-subdir-test 2024-04-14T11:00:24.523 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/30 file after the snapshot 2024-04-14T11:00:24.524 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/31 file after the snapshot 2024-04-14T11:00:24.526 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/32 file after the snapshot 2024-04-14T11:00:24.527 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/33 file after the snapshot 2024-04-14T11:00:24.530 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/34 file after the snapshot 2024-04-14T11:00:24.531 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/35 file after the snapshot 2024-04-14T11:00:24.532 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/36 file after the snapshot 2024-04-14T11:00:24.534 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/37 file after the snapshot 2024-04-14T11:00:24.536 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/38 file after the snapshot 2024-04-14T11:00:24.537 INFO:tasks.workunit.client.0.smithi084.stdout: create 213/39 file after the snapshot 2024-04-14T11:00:24.539 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/.snap/snap-subdir-test 2024-04-14T11:00:24.551 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/30 file after the snapshot 2024-04-14T11:00:24.552 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/31 file after the snapshot 2024-04-14T11:00:24.554 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/32 file after the snapshot 2024-04-14T11:00:24.555 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/33 file after the snapshot 2024-04-14T11:00:24.557 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/34 file after the snapshot 2024-04-14T11:00:24.559 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/35 file after the snapshot 2024-04-14T11:00:24.560 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/36 file after the snapshot 2024-04-14T11:00:24.562 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/37 file after the snapshot 2024-04-14T11:00:24.564 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/38 file after the snapshot 2024-04-14T11:00:24.565 INFO:tasks.workunit.client.0.smithi084.stdout: create 214/39 file after the snapshot 2024-04-14T11:00:24.567 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/.snap/snap-subdir-test 2024-04-14T11:00:24.579 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/30 file after the snapshot 2024-04-14T11:00:24.580 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/31 file after the snapshot 2024-04-14T11:00:24.582 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/32 file after the snapshot 2024-04-14T11:00:24.584 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/33 file after the snapshot 2024-04-14T11:00:24.585 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/34 file after the snapshot 2024-04-14T11:00:24.587 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/35 file after the snapshot 2024-04-14T11:00:24.589 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/36 file after the snapshot 2024-04-14T11:00:24.590 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/37 file after the snapshot 2024-04-14T11:00:24.592 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/38 file after the snapshot 2024-04-14T11:00:24.594 INFO:tasks.workunit.client.0.smithi084.stdout: create 215/39 file after the snapshot 2024-04-14T11:00:24.596 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/.snap/snap-subdir-test 2024-04-14T11:00:24.608 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/30 file after the snapshot 2024-04-14T11:00:24.608 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/31 file after the snapshot 2024-04-14T11:00:24.611 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/32 file after the snapshot 2024-04-14T11:00:24.612 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/33 file after the snapshot 2024-04-14T11:00:24.614 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/34 file after the snapshot 2024-04-14T11:00:24.616 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/35 file after the snapshot 2024-04-14T11:00:24.617 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/36 file after the snapshot 2024-04-14T11:00:24.619 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/37 file after the snapshot 2024-04-14T11:00:24.620 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/38 file after the snapshot 2024-04-14T11:00:24.622 INFO:tasks.workunit.client.0.smithi084.stdout: create 216/39 file after the snapshot 2024-04-14T11:00:24.624 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/.snap/snap-subdir-test 2024-04-14T11:00:24.636 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/30 file after the snapshot 2024-04-14T11:00:24.637 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/31 file after the snapshot 2024-04-14T11:00:24.639 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/32 file after the snapshot 2024-04-14T11:00:24.640 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/33 file after the snapshot 2024-04-14T11:00:24.642 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/34 file after the snapshot 2024-04-14T11:00:24.643 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/35 file after the snapshot 2024-04-14T11:00:24.645 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/36 file after the snapshot 2024-04-14T11:00:24.646 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/37 file after the snapshot 2024-04-14T11:00:24.648 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/38 file after the snapshot 2024-04-14T11:00:24.650 INFO:tasks.workunit.client.0.smithi084.stdout: create 217/39 file after the snapshot 2024-04-14T11:00:24.651 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/.snap/snap-subdir-test 2024-04-14T11:00:24.664 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/30 file after the snapshot 2024-04-14T11:00:24.665 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/31 file after the snapshot 2024-04-14T11:00:24.667 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/32 file after the snapshot 2024-04-14T11:00:24.669 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/33 file after the snapshot 2024-04-14T11:00:24.671 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/34 file after the snapshot 2024-04-14T11:00:24.672 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/35 file after the snapshot 2024-04-14T11:00:24.674 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/36 file after the snapshot 2024-04-14T11:00:24.675 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/37 file after the snapshot 2024-04-14T11:00:24.677 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/38 file after the snapshot 2024-04-14T11:00:24.679 INFO:tasks.workunit.client.0.smithi084.stdout: create 218/39 file after the snapshot 2024-04-14T11:00:24.681 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/.snap/snap-subdir-test 2024-04-14T11:00:24.694 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/30 file after the snapshot 2024-04-14T11:00:24.696 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/31 file after the snapshot 2024-04-14T11:00:24.698 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/32 file after the snapshot 2024-04-14T11:00:24.700 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/33 file after the snapshot 2024-04-14T11:00:24.701 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/34 file after the snapshot 2024-04-14T11:00:24.703 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/35 file after the snapshot 2024-04-14T11:00:24.705 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/36 file after the snapshot 2024-04-14T11:00:24.707 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/37 file after the snapshot 2024-04-14T11:00:24.708 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/38 file after the snapshot 2024-04-14T11:00:24.710 INFO:tasks.workunit.client.0.smithi084.stdout: create 219/39 file after the snapshot 2024-04-14T11:00:24.713 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/.snap/snap-subdir-test 2024-04-14T11:00:24.726 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/30 file after the snapshot 2024-04-14T11:00:24.727 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/31 file after the snapshot 2024-04-14T11:00:24.729 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/32 file after the snapshot 2024-04-14T11:00:24.731 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/33 file after the snapshot 2024-04-14T11:00:24.732 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/34 file after the snapshot 2024-04-14T11:00:24.734 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/35 file after the snapshot 2024-04-14T11:00:24.736 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/36 file after the snapshot 2024-04-14T11:00:24.737 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/37 file after the snapshot 2024-04-14T11:00:24.739 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/38 file after the snapshot 2024-04-14T11:00:24.741 INFO:tasks.workunit.client.0.smithi084.stdout: create 220/39 file after the snapshot 2024-04-14T11:00:24.742 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/.snap/snap-subdir-test 2024-04-14T11:00:24.755 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/30 file after the snapshot 2024-04-14T11:00:24.756 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/31 file after the snapshot 2024-04-14T11:00:24.758 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/32 file after the snapshot 2024-04-14T11:00:24.759 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/33 file after the snapshot 2024-04-14T11:00:24.847 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/34 file after the snapshot 2024-04-14T11:00:24.848 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/35 file after the snapshot 2024-04-14T11:00:24.850 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/36 file after the snapshot 2024-04-14T11:00:24.852 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/37 file after the snapshot 2024-04-14T11:00:24.854 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/38 file after the snapshot 2024-04-14T11:00:24.856 INFO:tasks.workunit.client.0.smithi084.stdout: create 221/39 file after the snapshot 2024-04-14T11:00:24.858 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/.snap/snap-subdir-test 2024-04-14T11:00:24.910 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/30 file after the snapshot 2024-04-14T11:00:24.912 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/31 file after the snapshot 2024-04-14T11:00:24.914 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/32 file after the snapshot 2024-04-14T11:00:24.915 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/33 file after the snapshot 2024-04-14T11:00:24.917 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/34 file after the snapshot 2024-04-14T11:00:24.919 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/35 file after the snapshot 2024-04-14T11:00:24.920 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/36 file after the snapshot 2024-04-14T11:00:24.922 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/37 file after the snapshot 2024-04-14T11:00:24.924 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/38 file after the snapshot 2024-04-14T11:00:24.926 INFO:tasks.workunit.client.0.smithi084.stdout: create 222/39 file after the snapshot 2024-04-14T11:00:24.928 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/.snap/snap-subdir-test 2024-04-14T11:00:24.940 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/30 file after the snapshot 2024-04-14T11:00:24.941 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/31 file after the snapshot 2024-04-14T11:00:24.943 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/32 file after the snapshot 2024-04-14T11:00:24.945 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/33 file after the snapshot 2024-04-14T11:00:24.946 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/34 file after the snapshot 2024-04-14T11:00:24.948 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/35 file after the snapshot 2024-04-14T11:00:24.950 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/36 file after the snapshot 2024-04-14T11:00:24.951 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/37 file after the snapshot 2024-04-14T11:00:24.953 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/38 file after the snapshot 2024-04-14T11:00:24.955 INFO:tasks.workunit.client.0.smithi084.stdout: create 223/39 file after the snapshot 2024-04-14T11:00:24.956 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/.snap/snap-subdir-test 2024-04-14T11:00:24.969 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/30 file after the snapshot 2024-04-14T11:00:24.971 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/31 file after the snapshot 2024-04-14T11:00:24.972 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/32 file after the snapshot 2024-04-14T11:00:24.974 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/33 file after the snapshot 2024-04-14T11:00:24.975 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/34 file after the snapshot 2024-04-14T11:00:24.977 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/35 file after the snapshot 2024-04-14T11:00:24.979 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/36 file after the snapshot 2024-04-14T11:00:24.980 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/37 file after the snapshot 2024-04-14T11:00:24.982 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/38 file after the snapshot 2024-04-14T11:00:24.983 INFO:tasks.workunit.client.0.smithi084.stdout: create 224/39 file after the snapshot 2024-04-14T11:00:24.985 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/.snap/snap-subdir-test 2024-04-14T11:00:24.999 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/30 file after the snapshot 2024-04-14T11:00:25.003 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/31 file after the snapshot 2024-04-14T11:00:25.003 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/32 file after the snapshot 2024-04-14T11:00:25.004 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/33 file after the snapshot 2024-04-14T11:00:25.006 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/34 file after the snapshot 2024-04-14T11:00:25.008 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/35 file after the snapshot 2024-04-14T11:00:25.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/36 file after the snapshot 2024-04-14T11:00:25.011 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/37 file after the snapshot 2024-04-14T11:00:25.012 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/38 file after the snapshot 2024-04-14T11:00:25.014 INFO:tasks.workunit.client.0.smithi084.stdout: create 225/39 file after the snapshot 2024-04-14T11:00:25.016 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/.snap/snap-subdir-test 2024-04-14T11:00:25.028 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/30 file after the snapshot 2024-04-14T11:00:25.030 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/31 file after the snapshot 2024-04-14T11:00:25.032 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/32 file after the snapshot 2024-04-14T11:00:25.034 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/33 file after the snapshot 2024-04-14T11:00:25.035 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/34 file after the snapshot 2024-04-14T11:00:25.037 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/35 file after the snapshot 2024-04-14T11:00:25.039 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/36 file after the snapshot 2024-04-14T11:00:25.040 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/37 file after the snapshot 2024-04-14T11:00:25.042 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/38 file after the snapshot 2024-04-14T11:00:25.043 INFO:tasks.workunit.client.0.smithi084.stdout: create 226/39 file after the snapshot 2024-04-14T11:00:25.045 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/.snap/snap-subdir-test 2024-04-14T11:00:25.058 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/30 file after the snapshot 2024-04-14T11:00:25.059 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/31 file after the snapshot 2024-04-14T11:00:25.061 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/32 file after the snapshot 2024-04-14T11:00:25.063 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/33 file after the snapshot 2024-04-14T11:00:25.064 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/34 file after the snapshot 2024-04-14T11:00:25.066 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/35 file after the snapshot 2024-04-14T11:00:25.068 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/36 file after the snapshot 2024-04-14T11:00:25.070 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/37 file after the snapshot 2024-04-14T11:00:25.071 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/38 file after the snapshot 2024-04-14T11:00:25.073 INFO:tasks.workunit.client.0.smithi084.stdout: create 227/39 file after the snapshot 2024-04-14T11:00:25.075 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/.snap/snap-subdir-test 2024-04-14T11:00:25.088 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/30 file after the snapshot 2024-04-14T11:00:25.090 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/31 file after the snapshot 2024-04-14T11:00:25.092 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/32 file after the snapshot 2024-04-14T11:00:25.094 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/33 file after the snapshot 2024-04-14T11:00:25.096 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/34 file after the snapshot 2024-04-14T11:00:25.097 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/35 file after the snapshot 2024-04-14T11:00:25.099 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/36 file after the snapshot 2024-04-14T11:00:25.101 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/37 file after the snapshot 2024-04-14T11:00:25.102 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/38 file after the snapshot 2024-04-14T11:00:25.104 INFO:tasks.workunit.client.0.smithi084.stdout: create 228/39 file after the snapshot 2024-04-14T11:00:25.106 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/.snap/snap-subdir-test 2024-04-14T11:00:25.119 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/30 file after the snapshot 2024-04-14T11:00:25.121 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/31 file after the snapshot 2024-04-14T11:00:25.122 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/32 file after the snapshot 2024-04-14T11:00:25.124 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/33 file after the snapshot 2024-04-14T11:00:25.126 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/34 file after the snapshot 2024-04-14T11:00:25.127 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/35 file after the snapshot 2024-04-14T11:00:25.129 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/36 file after the snapshot 2024-04-14T11:00:25.131 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/37 file after the snapshot 2024-04-14T11:00:25.132 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/38 file after the snapshot 2024-04-14T11:00:25.134 INFO:tasks.workunit.client.0.smithi084.stdout: create 229/39 file after the snapshot 2024-04-14T11:00:25.136 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/.snap/snap-subdir-test 2024-04-14T11:00:25.148 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/30 file after the snapshot 2024-04-14T11:00:25.149 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/31 file after the snapshot 2024-04-14T11:00:25.151 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/32 file after the snapshot 2024-04-14T11:00:25.153 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/33 file after the snapshot 2024-04-14T11:00:25.155 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/34 file after the snapshot 2024-04-14T11:00:25.156 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/35 file after the snapshot 2024-04-14T11:00:25.158 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/36 file after the snapshot 2024-04-14T11:00:25.159 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/37 file after the snapshot 2024-04-14T11:00:25.161 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/38 file after the snapshot 2024-04-14T11:00:25.163 INFO:tasks.workunit.client.0.smithi084.stdout: create 230/39 file after the snapshot 2024-04-14T11:00:25.164 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/.snap/snap-subdir-test 2024-04-14T11:00:25.177 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/30 file after the snapshot 2024-04-14T11:00:25.178 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/31 file after the snapshot 2024-04-14T11:00:25.180 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/32 file after the snapshot 2024-04-14T11:00:25.182 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/33 file after the snapshot 2024-04-14T11:00:25.184 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/34 file after the snapshot 2024-04-14T11:00:25.185 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/35 file after the snapshot 2024-04-14T11:00:25.187 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/36 file after the snapshot 2024-04-14T11:00:25.188 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/37 file after the snapshot 2024-04-14T11:00:25.190 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/38 file after the snapshot 2024-04-14T11:00:25.192 INFO:tasks.workunit.client.0.smithi084.stdout: create 231/39 file after the snapshot 2024-04-14T11:00:25.194 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/.snap/snap-subdir-test 2024-04-14T11:00:25.206 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/30 file after the snapshot 2024-04-14T11:00:25.208 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/31 file after the snapshot 2024-04-14T11:00:25.209 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/32 file after the snapshot 2024-04-14T11:00:25.211 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/33 file after the snapshot 2024-04-14T11:00:25.213 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/34 file after the snapshot 2024-04-14T11:00:25.214 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/35 file after the snapshot 2024-04-14T11:00:25.216 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/36 file after the snapshot 2024-04-14T11:00:25.218 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/37 file after the snapshot 2024-04-14T11:00:25.219 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/38 file after the snapshot 2024-04-14T11:00:25.221 INFO:tasks.workunit.client.0.smithi084.stdout: create 232/39 file after the snapshot 2024-04-14T11:00:25.222 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/.snap/snap-subdir-test 2024-04-14T11:00:25.235 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/30 file after the snapshot 2024-04-14T11:00:25.237 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/31 file after the snapshot 2024-04-14T11:00:25.238 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/32 file after the snapshot 2024-04-14T11:00:25.240 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/33 file after the snapshot 2024-04-14T11:00:25.242 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/34 file after the snapshot 2024-04-14T11:00:25.243 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/35 file after the snapshot 2024-04-14T11:00:25.246 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/36 file after the snapshot 2024-04-14T11:00:25.247 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/37 file after the snapshot 2024-04-14T11:00:25.249 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/38 file after the snapshot 2024-04-14T11:00:25.251 INFO:tasks.workunit.client.0.smithi084.stdout: create 233/39 file after the snapshot 2024-04-14T11:00:25.252 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/.snap/snap-subdir-test 2024-04-14T11:00:25.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/30 file after the snapshot 2024-04-14T11:00:25.266 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/31 file after the snapshot 2024-04-14T11:00:25.268 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/32 file after the snapshot 2024-04-14T11:00:25.269 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/33 file after the snapshot 2024-04-14T11:00:25.271 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/34 file after the snapshot 2024-04-14T11:00:25.273 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/35 file after the snapshot 2024-04-14T11:00:25.274 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/36 file after the snapshot 2024-04-14T11:00:25.276 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/37 file after the snapshot 2024-04-14T11:00:25.278 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/38 file after the snapshot 2024-04-14T11:00:25.279 INFO:tasks.workunit.client.0.smithi084.stdout: create 234/39 file after the snapshot 2024-04-14T11:00:25.281 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/.snap/snap-subdir-test 2024-04-14T11:00:25.293 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/30 file after the snapshot 2024-04-14T11:00:25.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/31 file after the snapshot 2024-04-14T11:00:25.296 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/32 file after the snapshot 2024-04-14T11:00:25.298 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/33 file after the snapshot 2024-04-14T11:00:25.299 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/34 file after the snapshot 2024-04-14T11:00:25.301 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/35 file after the snapshot 2024-04-14T11:00:25.302 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/36 file after the snapshot 2024-04-14T11:00:25.304 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/37 file after the snapshot 2024-04-14T11:00:25.306 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/38 file after the snapshot 2024-04-14T11:00:25.307 INFO:tasks.workunit.client.0.smithi084.stdout: create 235/39 file after the snapshot 2024-04-14T11:00:25.309 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/.snap/snap-subdir-test 2024-04-14T11:00:25.321 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/30 file after the snapshot 2024-04-14T11:00:25.323 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/31 file after the snapshot 2024-04-14T11:00:25.324 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/32 file after the snapshot 2024-04-14T11:00:25.326 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/33 file after the snapshot 2024-04-14T11:00:25.328 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/34 file after the snapshot 2024-04-14T11:00:25.329 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/35 file after the snapshot 2024-04-14T11:00:25.331 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/36 file after the snapshot 2024-04-14T11:00:25.332 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/37 file after the snapshot 2024-04-14T11:00:25.334 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/38 file after the snapshot 2024-04-14T11:00:25.335 INFO:tasks.workunit.client.0.smithi084.stdout: create 236/39 file after the snapshot 2024-04-14T11:00:25.337 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/.snap/snap-subdir-test 2024-04-14T11:00:25.349 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/30 file after the snapshot 2024-04-14T11:00:25.350 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/31 file after the snapshot 2024-04-14T11:00:25.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/32 file after the snapshot 2024-04-14T11:00:25.354 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/33 file after the snapshot 2024-04-14T11:00:25.356 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/34 file after the snapshot 2024-04-14T11:00:25.358 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/35 file after the snapshot 2024-04-14T11:00:25.359 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/36 file after the snapshot 2024-04-14T11:00:25.361 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/37 file after the snapshot 2024-04-14T11:00:25.362 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/38 file after the snapshot 2024-04-14T11:00:25.364 INFO:tasks.workunit.client.0.smithi084.stdout: create 237/39 file after the snapshot 2024-04-14T11:00:25.365 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/.snap/snap-subdir-test 2024-04-14T11:00:25.378 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/30 file after the snapshot 2024-04-14T11:00:25.379 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/31 file after the snapshot 2024-04-14T11:00:25.381 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/32 file after the snapshot 2024-04-14T11:00:25.382 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/33 file after the snapshot 2024-04-14T11:00:25.384 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/34 file after the snapshot 2024-04-14T11:00:25.386 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/35 file after the snapshot 2024-04-14T11:00:25.388 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/36 file after the snapshot 2024-04-14T11:00:25.389 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/37 file after the snapshot 2024-04-14T11:00:25.391 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/38 file after the snapshot 2024-04-14T11:00:25.393 INFO:tasks.workunit.client.0.smithi084.stdout: create 238/39 file after the snapshot 2024-04-14T11:00:25.394 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/.snap/snap-subdir-test 2024-04-14T11:00:25.406 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/30 file after the snapshot 2024-04-14T11:00:25.408 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/31 file after the snapshot 2024-04-14T11:00:25.409 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/32 file after the snapshot 2024-04-14T11:00:25.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/33 file after the snapshot 2024-04-14T11:00:25.413 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/34 file after the snapshot 2024-04-14T11:00:25.414 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/35 file after the snapshot 2024-04-14T11:00:25.416 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/36 file after the snapshot 2024-04-14T11:00:25.418 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/37 file after the snapshot 2024-04-14T11:00:25.419 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/38 file after the snapshot 2024-04-14T11:00:25.421 INFO:tasks.workunit.client.0.smithi084.stdout: create 239/39 file after the snapshot 2024-04-14T11:00:25.426 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/.snap/snap-subdir-test 2024-04-14T11:00:25.435 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/30 file after the snapshot 2024-04-14T11:00:25.437 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/31 file after the snapshot 2024-04-14T11:00:25.439 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/32 file after the snapshot 2024-04-14T11:00:25.440 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/33 file after the snapshot 2024-04-14T11:00:25.442 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/34 file after the snapshot 2024-04-14T11:00:25.444 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/35 file after the snapshot 2024-04-14T11:00:25.445 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/36 file after the snapshot 2024-04-14T11:00:25.447 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/37 file after the snapshot 2024-04-14T11:00:25.448 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/38 file after the snapshot 2024-04-14T11:00:25.450 INFO:tasks.workunit.client.0.smithi084.stdout: create 240/39 file after the snapshot 2024-04-14T11:00:25.453 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/.snap/snap-subdir-test 2024-04-14T11:00:25.465 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/30 file after the snapshot 2024-04-14T11:00:25.466 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/31 file after the snapshot 2024-04-14T11:00:25.468 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/32 file after the snapshot 2024-04-14T11:00:25.470 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/33 file after the snapshot 2024-04-14T11:00:25.471 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/34 file after the snapshot 2024-04-14T11:00:25.473 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/35 file after the snapshot 2024-04-14T11:00:25.475 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/36 file after the snapshot 2024-04-14T11:00:25.476 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/37 file after the snapshot 2024-04-14T11:00:25.478 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/38 file after the snapshot 2024-04-14T11:00:25.480 INFO:tasks.workunit.client.0.smithi084.stdout: create 241/39 file after the snapshot 2024-04-14T11:00:25.481 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/.snap/snap-subdir-test 2024-04-14T11:00:25.495 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/30 file after the snapshot 2024-04-14T11:00:25.496 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/31 file after the snapshot 2024-04-14T11:00:25.498 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/32 file after the snapshot 2024-04-14T11:00:25.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/33 file after the snapshot 2024-04-14T11:00:25.502 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/34 file after the snapshot 2024-04-14T11:00:25.503 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/35 file after the snapshot 2024-04-14T11:00:25.505 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/36 file after the snapshot 2024-04-14T11:00:25.506 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/37 file after the snapshot 2024-04-14T11:00:25.508 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/38 file after the snapshot 2024-04-14T11:00:25.510 INFO:tasks.workunit.client.0.smithi084.stdout: create 242/39 file after the snapshot 2024-04-14T11:00:25.512 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/.snap/snap-subdir-test 2024-04-14T11:00:25.524 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/30 file after the snapshot 2024-04-14T11:00:25.525 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/31 file after the snapshot 2024-04-14T11:00:25.527 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/32 file after the snapshot 2024-04-14T11:00:25.528 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/33 file after the snapshot 2024-04-14T11:00:25.530 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/34 file after the snapshot 2024-04-14T11:00:25.532 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/35 file after the snapshot 2024-04-14T11:00:25.534 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/36 file after the snapshot 2024-04-14T11:00:25.535 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/37 file after the snapshot 2024-04-14T11:00:25.537 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/38 file after the snapshot 2024-04-14T11:00:25.538 INFO:tasks.workunit.client.0.smithi084.stdout: create 243/39 file after the snapshot 2024-04-14T11:00:25.540 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/.snap/snap-subdir-test 2024-04-14T11:00:25.553 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/30 file after the snapshot 2024-04-14T11:00:25.554 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/31 file after the snapshot 2024-04-14T11:00:25.556 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/32 file after the snapshot 2024-04-14T11:00:25.557 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/33 file after the snapshot 2024-04-14T11:00:25.559 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/34 file after the snapshot 2024-04-14T11:00:25.561 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/35 file after the snapshot 2024-04-14T11:00:25.563 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/36 file after the snapshot 2024-04-14T11:00:25.565 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/37 file after the snapshot 2024-04-14T11:00:25.567 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/38 file after the snapshot 2024-04-14T11:00:25.569 INFO:tasks.workunit.client.0.smithi084.stdout: create 244/39 file after the snapshot 2024-04-14T11:00:25.570 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/.snap/snap-subdir-test 2024-04-14T11:00:25.583 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/30 file after the snapshot 2024-04-14T11:00:25.585 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/31 file after the snapshot 2024-04-14T11:00:25.586 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/32 file after the snapshot 2024-04-14T11:00:25.588 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/33 file after the snapshot 2024-04-14T11:00:25.590 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/34 file after the snapshot 2024-04-14T11:00:25.592 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/35 file after the snapshot 2024-04-14T11:00:25.593 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/36 file after the snapshot 2024-04-14T11:00:25.595 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/37 file after the snapshot 2024-04-14T11:00:25.597 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/38 file after the snapshot 2024-04-14T11:00:25.598 INFO:tasks.workunit.client.0.smithi084.stdout: create 245/39 file after the snapshot 2024-04-14T11:00:25.600 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/.snap/snap-subdir-test 2024-04-14T11:00:25.614 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/30 file after the snapshot 2024-04-14T11:00:25.615 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/31 file after the snapshot 2024-04-14T11:00:25.617 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/32 file after the snapshot 2024-04-14T11:00:25.619 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/33 file after the snapshot 2024-04-14T11:00:25.620 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/34 file after the snapshot 2024-04-14T11:00:25.622 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/35 file after the snapshot 2024-04-14T11:00:25.624 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/36 file after the snapshot 2024-04-14T11:00:25.625 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/37 file after the snapshot 2024-04-14T11:00:25.627 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/38 file after the snapshot 2024-04-14T11:00:25.630 INFO:tasks.workunit.client.0.smithi084.stdout: create 246/39 file after the snapshot 2024-04-14T11:00:25.630 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/.snap/snap-subdir-test 2024-04-14T11:00:25.643 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/30 file after the snapshot 2024-04-14T11:00:25.646 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/31 file after the snapshot 2024-04-14T11:00:25.648 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/32 file after the snapshot 2024-04-14T11:00:25.649 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/33 file after the snapshot 2024-04-14T11:00:25.650 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/34 file after the snapshot 2024-04-14T11:00:25.652 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/35 file after the snapshot 2024-04-14T11:00:25.654 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/36 file after the snapshot 2024-04-14T11:00:25.655 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/37 file after the snapshot 2024-04-14T11:00:25.657 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/38 file after the snapshot 2024-04-14T11:00:25.659 INFO:tasks.workunit.client.0.smithi084.stdout: create 247/39 file after the snapshot 2024-04-14T11:00:25.660 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/.snap/snap-subdir-test 2024-04-14T11:00:25.674 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/30 file after the snapshot 2024-04-14T11:00:25.676 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/31 file after the snapshot 2024-04-14T11:00:25.677 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/32 file after the snapshot 2024-04-14T11:00:25.679 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/33 file after the snapshot 2024-04-14T11:00:25.680 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/34 file after the snapshot 2024-04-14T11:00:25.682 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/35 file after the snapshot 2024-04-14T11:00:25.684 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/36 file after the snapshot 2024-04-14T11:00:25.686 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/37 file after the snapshot 2024-04-14T11:00:25.687 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/38 file after the snapshot 2024-04-14T11:00:25.689 INFO:tasks.workunit.client.0.smithi084.stdout: create 248/39 file after the snapshot 2024-04-14T11:00:25.690 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/.snap/snap-subdir-test 2024-04-14T11:00:25.703 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/30 file after the snapshot 2024-04-14T11:00:25.704 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/31 file after the snapshot 2024-04-14T11:00:25.706 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/32 file after the snapshot 2024-04-14T11:00:25.708 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/33 file after the snapshot 2024-04-14T11:00:25.709 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/34 file after the snapshot 2024-04-14T11:00:25.711 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/35 file after the snapshot 2024-04-14T11:00:25.714 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/36 file after the snapshot 2024-04-14T11:00:25.715 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/37 file after the snapshot 2024-04-14T11:00:25.717 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/38 file after the snapshot 2024-04-14T11:00:25.718 INFO:tasks.workunit.client.0.smithi084.stdout: create 249/39 file after the snapshot 2024-04-14T11:00:25.720 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/.snap/snap-subdir-test 2024-04-14T11:00:25.733 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/30 file after the snapshot 2024-04-14T11:00:25.735 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/31 file after the snapshot 2024-04-14T11:00:25.737 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/32 file after the snapshot 2024-04-14T11:00:25.738 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/33 file after the snapshot 2024-04-14T11:00:25.739 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/34 file after the snapshot 2024-04-14T11:00:25.741 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/35 file after the snapshot 2024-04-14T11:00:25.743 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/36 file after the snapshot 2024-04-14T11:00:25.744 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/37 file after the snapshot 2024-04-14T11:00:25.747 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/38 file after the snapshot 2024-04-14T11:00:25.749 INFO:tasks.workunit.client.0.smithi084.stdout: create 250/39 file after the snapshot 2024-04-14T11:00:25.750 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/.snap/snap-subdir-test 2024-04-14T11:00:25.762 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/30 file after the snapshot 2024-04-14T11:00:25.764 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/31 file after the snapshot 2024-04-14T11:00:25.765 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/32 file after the snapshot 2024-04-14T11:00:25.767 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/33 file after the snapshot 2024-04-14T11:00:25.769 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/34 file after the snapshot 2024-04-14T11:00:25.770 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/35 file after the snapshot 2024-04-14T11:00:25.785 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/36 file after the snapshot 2024-04-14T11:00:25.919 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/37 file after the snapshot 2024-04-14T11:00:25.920 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/38 file after the snapshot 2024-04-14T11:00:25.922 INFO:tasks.workunit.client.0.smithi084.stdout: create 251/39 file after the snapshot 2024-04-14T11:00:25.924 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/.snap/snap-subdir-test 2024-04-14T11:00:25.968 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/30 file after the snapshot 2024-04-14T11:00:25.969 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/31 file after the snapshot 2024-04-14T11:00:25.972 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/32 file after the snapshot 2024-04-14T11:00:25.973 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/33 file after the snapshot 2024-04-14T11:00:25.975 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/34 file after the snapshot 2024-04-14T11:00:25.977 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/35 file after the snapshot 2024-04-14T11:00:25.979 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/36 file after the snapshot 2024-04-14T11:00:25.980 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/37 file after the snapshot 2024-04-14T11:00:25.982 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/38 file after the snapshot 2024-04-14T11:00:25.983 INFO:tasks.workunit.client.0.smithi084.stdout: create 252/39 file after the snapshot 2024-04-14T11:00:25.985 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/.snap/snap-subdir-test 2024-04-14T11:00:25.998 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/30 file after the snapshot 2024-04-14T11:00:26.000 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/31 file after the snapshot 2024-04-14T11:00:26.001 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/32 file after the snapshot 2024-04-14T11:00:26.003 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/33 file after the snapshot 2024-04-14T11:00:26.005 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/34 file after the snapshot 2024-04-14T11:00:26.006 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/35 file after the snapshot 2024-04-14T11:00:26.008 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/36 file after the snapshot 2024-04-14T11:00:26.009 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/37 file after the snapshot 2024-04-14T11:00:26.011 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/38 file after the snapshot 2024-04-14T11:00:26.013 INFO:tasks.workunit.client.0.smithi084.stdout: create 253/39 file after the snapshot 2024-04-14T11:00:26.014 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/.snap/snap-subdir-test 2024-04-14T11:00:26.027 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/30 file after the snapshot 2024-04-14T11:00:26.028 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/31 file after the snapshot 2024-04-14T11:00:26.030 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/32 file after the snapshot 2024-04-14T11:00:26.032 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/33 file after the snapshot 2024-04-14T11:00:26.034 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/34 file after the snapshot 2024-04-14T11:00:26.036 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/35 file after the snapshot 2024-04-14T11:00:26.037 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/36 file after the snapshot 2024-04-14T11:00:26.039 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/37 file after the snapshot 2024-04-14T11:00:26.040 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/38 file after the snapshot 2024-04-14T11:00:26.042 INFO:tasks.workunit.client.0.smithi084.stdout: create 254/39 file after the snapshot 2024-04-14T11:00:26.045 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/.snap/snap-subdir-test 2024-04-14T11:00:26.057 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/30 file after the snapshot 2024-04-14T11:00:26.059 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/31 file after the snapshot 2024-04-14T11:00:26.060 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/32 file after the snapshot 2024-04-14T11:00:26.062 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/33 file after the snapshot 2024-04-14T11:00:26.064 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/34 file after the snapshot 2024-04-14T11:00:26.065 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/35 file after the snapshot 2024-04-14T11:00:26.067 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/36 file after the snapshot 2024-04-14T11:00:26.069 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/37 file after the snapshot 2024-04-14T11:00:26.071 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/38 file after the snapshot 2024-04-14T11:00:26.072 INFO:tasks.workunit.client.0.smithi084.stdout: create 255/39 file after the snapshot 2024-04-14T11:00:26.074 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/.snap/snap-subdir-test 2024-04-14T11:00:26.087 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/30 file after the snapshot 2024-04-14T11:00:26.088 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/31 file after the snapshot 2024-04-14T11:00:26.090 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/32 file after the snapshot 2024-04-14T11:00:26.092 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/33 file after the snapshot 2024-04-14T11:00:26.093 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/34 file after the snapshot 2024-04-14T11:00:26.095 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/35 file after the snapshot 2024-04-14T11:00:26.097 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/36 file after the snapshot 2024-04-14T11:00:26.099 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/37 file after the snapshot 2024-04-14T11:00:26.101 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/38 file after the snapshot 2024-04-14T11:00:26.103 INFO:tasks.workunit.client.0.smithi084.stdout: create 256/39 file after the snapshot 2024-04-14T11:00:26.105 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/.snap/snap-subdir-test 2024-04-14T11:00:26.119 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/30 file after the snapshot 2024-04-14T11:00:26.121 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/31 file after the snapshot 2024-04-14T11:00:26.122 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/32 file after the snapshot 2024-04-14T11:00:26.124 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/33 file after the snapshot 2024-04-14T11:00:26.126 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/34 file after the snapshot 2024-04-14T11:00:26.128 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/35 file after the snapshot 2024-04-14T11:00:26.129 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/36 file after the snapshot 2024-04-14T11:00:26.131 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/37 file after the snapshot 2024-04-14T11:00:26.133 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/38 file after the snapshot 2024-04-14T11:00:26.134 INFO:tasks.workunit.client.0.smithi084.stdout: create 257/39 file after the snapshot 2024-04-14T11:00:26.136 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/.snap/snap-subdir-test 2024-04-14T11:00:26.149 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/30 file after the snapshot 2024-04-14T11:00:26.151 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/31 file after the snapshot 2024-04-14T11:00:26.153 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/32 file after the snapshot 2024-04-14T11:00:26.154 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/33 file after the snapshot 2024-04-14T11:00:26.156 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/34 file after the snapshot 2024-04-14T11:00:26.158 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/35 file after the snapshot 2024-04-14T11:00:26.159 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/36 file after the snapshot 2024-04-14T11:00:26.161 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/37 file after the snapshot 2024-04-14T11:00:26.163 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/38 file after the snapshot 2024-04-14T11:00:26.164 INFO:tasks.workunit.client.0.smithi084.stdout: create 258/39 file after the snapshot 2024-04-14T11:00:26.166 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/.snap/snap-subdir-test 2024-04-14T11:00:26.178 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/30 file after the snapshot 2024-04-14T11:00:26.180 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/31 file after the snapshot 2024-04-14T11:00:26.181 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/32 file after the snapshot 2024-04-14T11:00:26.183 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/33 file after the snapshot 2024-04-14T11:00:26.184 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/34 file after the snapshot 2024-04-14T11:00:26.186 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/35 file after the snapshot 2024-04-14T11:00:26.188 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/36 file after the snapshot 2024-04-14T11:00:26.189 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/37 file after the snapshot 2024-04-14T11:00:26.191 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/38 file after the snapshot 2024-04-14T11:00:26.192 INFO:tasks.workunit.client.0.smithi084.stdout: create 259/39 file after the snapshot 2024-04-14T11:00:26.194 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/.snap/snap-subdir-test 2024-04-14T11:00:26.207 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/30 file after the snapshot 2024-04-14T11:00:26.208 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/31 file after the snapshot 2024-04-14T11:00:26.210 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/32 file after the snapshot 2024-04-14T11:00:26.211 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/33 file after the snapshot 2024-04-14T11:00:26.213 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/34 file after the snapshot 2024-04-14T11:00:26.214 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/35 file after the snapshot 2024-04-14T11:00:26.216 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/36 file after the snapshot 2024-04-14T11:00:26.218 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/37 file after the snapshot 2024-04-14T11:00:26.219 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/38 file after the snapshot 2024-04-14T11:00:26.221 INFO:tasks.workunit.client.0.smithi084.stdout: create 260/39 file after the snapshot 2024-04-14T11:00:26.222 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/.snap/snap-subdir-test 2024-04-14T11:00:26.235 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/30 file after the snapshot 2024-04-14T11:00:26.237 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/31 file after the snapshot 2024-04-14T11:00:26.238 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/32 file after the snapshot 2024-04-14T11:00:26.240 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/33 file after the snapshot 2024-04-14T11:00:26.241 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/34 file after the snapshot 2024-04-14T11:00:26.243 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/35 file after the snapshot 2024-04-14T11:00:26.245 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/36 file after the snapshot 2024-04-14T11:00:26.250 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/37 file after the snapshot 2024-04-14T11:00:26.250 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/38 file after the snapshot 2024-04-14T11:00:26.252 INFO:tasks.workunit.client.0.smithi084.stdout: create 261/39 file after the snapshot 2024-04-14T11:00:26.252 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/.snap/snap-subdir-test 2024-04-14T11:00:26.264 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/30 file after the snapshot 2024-04-14T11:00:26.265 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/31 file after the snapshot 2024-04-14T11:00:26.267 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/32 file after the snapshot 2024-04-14T11:00:26.269 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/33 file after the snapshot 2024-04-14T11:00:26.270 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/34 file after the snapshot 2024-04-14T11:00:26.272 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/35 file after the snapshot 2024-04-14T11:00:26.274 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/36 file after the snapshot 2024-04-14T11:00:26.276 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/37 file after the snapshot 2024-04-14T11:00:26.277 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/38 file after the snapshot 2024-04-14T11:00:26.279 INFO:tasks.workunit.client.0.smithi084.stdout: create 262/39 file after the snapshot 2024-04-14T11:00:26.281 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/.snap/snap-subdir-test 2024-04-14T11:00:26.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/30 file after the snapshot 2024-04-14T11:00:26.295 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/31 file after the snapshot 2024-04-14T11:00:26.297 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/32 file after the snapshot 2024-04-14T11:00:26.299 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/33 file after the snapshot 2024-04-14T11:00:26.300 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/34 file after the snapshot 2024-04-14T11:00:26.302 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/35 file after the snapshot 2024-04-14T11:00:26.304 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/36 file after the snapshot 2024-04-14T11:00:26.305 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/37 file after the snapshot 2024-04-14T11:00:26.307 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/38 file after the snapshot 2024-04-14T11:00:26.309 INFO:tasks.workunit.client.0.smithi084.stdout: create 263/39 file after the snapshot 2024-04-14T11:00:26.310 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/.snap/snap-subdir-test 2024-04-14T11:00:26.323 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/30 file after the snapshot 2024-04-14T11:00:26.324 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/31 file after the snapshot 2024-04-14T11:00:26.326 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/32 file after the snapshot 2024-04-14T11:00:26.328 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/33 file after the snapshot 2024-04-14T11:00:26.330 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/34 file after the snapshot 2024-04-14T11:00:26.332 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/35 file after the snapshot 2024-04-14T11:00:26.333 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/36 file after the snapshot 2024-04-14T11:00:26.335 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/37 file after the snapshot 2024-04-14T11:00:26.337 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/38 file after the snapshot 2024-04-14T11:00:26.339 INFO:tasks.workunit.client.0.smithi084.stdout: create 264/39 file after the snapshot 2024-04-14T11:00:26.340 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/.snap/snap-subdir-test 2024-04-14T11:00:26.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/30 file after the snapshot 2024-04-14T11:00:26.354 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/31 file after the snapshot 2024-04-14T11:00:26.355 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/32 file after the snapshot 2024-04-14T11:00:26.357 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/33 file after the snapshot 2024-04-14T11:00:26.358 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/34 file after the snapshot 2024-04-14T11:00:26.360 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/35 file after the snapshot 2024-04-14T11:00:26.362 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/36 file after the snapshot 2024-04-14T11:00:26.363 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/37 file after the snapshot 2024-04-14T11:00:26.365 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/38 file after the snapshot 2024-04-14T11:00:26.366 INFO:tasks.workunit.client.0.smithi084.stdout: create 265/39 file after the snapshot 2024-04-14T11:00:26.368 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/.snap/snap-subdir-test 2024-04-14T11:00:26.381 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/30 file after the snapshot 2024-04-14T11:00:26.382 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/31 file after the snapshot 2024-04-14T11:00:26.384 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/32 file after the snapshot 2024-04-14T11:00:26.386 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/33 file after the snapshot 2024-04-14T11:00:26.387 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/34 file after the snapshot 2024-04-14T11:00:26.389 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/35 file after the snapshot 2024-04-14T11:00:26.391 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/36 file after the snapshot 2024-04-14T11:00:26.392 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/37 file after the snapshot 2024-04-14T11:00:26.394 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/38 file after the snapshot 2024-04-14T11:00:26.396 INFO:tasks.workunit.client.0.smithi084.stdout: create 266/39 file after the snapshot 2024-04-14T11:00:26.397 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/.snap/snap-subdir-test 2024-04-14T11:00:26.410 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/30 file after the snapshot 2024-04-14T11:00:26.412 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/31 file after the snapshot 2024-04-14T11:00:26.414 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/32 file after the snapshot 2024-04-14T11:00:26.416 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/33 file after the snapshot 2024-04-14T11:00:26.417 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/34 file after the snapshot 2024-04-14T11:00:26.419 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/35 file after the snapshot 2024-04-14T11:00:26.420 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/36 file after the snapshot 2024-04-14T11:00:26.422 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/37 file after the snapshot 2024-04-14T11:00:26.423 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/38 file after the snapshot 2024-04-14T11:00:26.425 INFO:tasks.workunit.client.0.smithi084.stdout: create 267/39 file after the snapshot 2024-04-14T11:00:26.427 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/.snap/snap-subdir-test 2024-04-14T11:00:26.439 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/30 file after the snapshot 2024-04-14T11:00:26.441 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/31 file after the snapshot 2024-04-14T11:00:26.442 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/32 file after the snapshot 2024-04-14T11:00:26.444 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/33 file after the snapshot 2024-04-14T11:00:26.446 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/34 file after the snapshot 2024-04-14T11:00:26.447 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/35 file after the snapshot 2024-04-14T11:00:26.449 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/36 file after the snapshot 2024-04-14T11:00:26.454 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/37 file after the snapshot 2024-04-14T11:00:26.454 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/38 file after the snapshot 2024-04-14T11:00:26.455 INFO:tasks.workunit.client.0.smithi084.stdout: create 268/39 file after the snapshot 2024-04-14T11:00:26.456 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/.snap/snap-subdir-test 2024-04-14T11:00:26.470 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/30 file after the snapshot 2024-04-14T11:00:26.472 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/31 file after the snapshot 2024-04-14T11:00:26.473 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/32 file after the snapshot 2024-04-14T11:00:26.475 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/33 file after the snapshot 2024-04-14T11:00:26.477 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/34 file after the snapshot 2024-04-14T11:00:26.479 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/35 file after the snapshot 2024-04-14T11:00:26.480 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/36 file after the snapshot 2024-04-14T11:00:26.482 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/37 file after the snapshot 2024-04-14T11:00:26.484 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/38 file after the snapshot 2024-04-14T11:00:26.486 INFO:tasks.workunit.client.0.smithi084.stdout: create 269/39 file after the snapshot 2024-04-14T11:00:26.488 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/.snap/snap-subdir-test 2024-04-14T11:00:26.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/30 file after the snapshot 2024-04-14T11:00:26.501 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/31 file after the snapshot 2024-04-14T11:00:26.503 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/32 file after the snapshot 2024-04-14T11:00:26.505 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/33 file after the snapshot 2024-04-14T11:00:26.507 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/34 file after the snapshot 2024-04-14T11:00:26.508 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/35 file after the snapshot 2024-04-14T11:00:26.510 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/36 file after the snapshot 2024-04-14T11:00:26.511 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/37 file after the snapshot 2024-04-14T11:00:26.513 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/38 file after the snapshot 2024-04-14T11:00:26.515 INFO:tasks.workunit.client.0.smithi084.stdout: create 270/39 file after the snapshot 2024-04-14T11:00:26.516 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/.snap/snap-subdir-test 2024-04-14T11:00:26.529 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/30 file after the snapshot 2024-04-14T11:00:26.531 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/31 file after the snapshot 2024-04-14T11:00:26.532 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/32 file after the snapshot 2024-04-14T11:00:26.534 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/33 file after the snapshot 2024-04-14T11:00:26.536 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/34 file after the snapshot 2024-04-14T11:00:26.537 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/35 file after the snapshot 2024-04-14T11:00:26.539 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/36 file after the snapshot 2024-04-14T11:00:26.540 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/37 file after the snapshot 2024-04-14T11:00:26.542 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/38 file after the snapshot 2024-04-14T11:00:26.544 INFO:tasks.workunit.client.0.smithi084.stdout: create 271/39 file after the snapshot 2024-04-14T11:00:26.545 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/.snap/snap-subdir-test 2024-04-14T11:00:26.560 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/30 file after the snapshot 2024-04-14T11:00:26.561 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/31 file after the snapshot 2024-04-14T11:00:26.563 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/32 file after the snapshot 2024-04-14T11:00:26.565 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/33 file after the snapshot 2024-04-14T11:00:26.567 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/34 file after the snapshot 2024-04-14T11:00:26.568 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/35 file after the snapshot 2024-04-14T11:00:26.570 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/36 file after the snapshot 2024-04-14T11:00:26.572 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/37 file after the snapshot 2024-04-14T11:00:26.573 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/38 file after the snapshot 2024-04-14T11:00:26.575 INFO:tasks.workunit.client.0.smithi084.stdout: create 272/39 file after the snapshot 2024-04-14T11:00:26.576 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/.snap/snap-subdir-test 2024-04-14T11:00:26.589 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/30 file after the snapshot 2024-04-14T11:00:26.591 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/31 file after the snapshot 2024-04-14T11:00:26.592 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/32 file after the snapshot 2024-04-14T11:00:26.594 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/33 file after the snapshot 2024-04-14T11:00:26.596 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/34 file after the snapshot 2024-04-14T11:00:26.597 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/35 file after the snapshot 2024-04-14T11:00:26.599 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/36 file after the snapshot 2024-04-14T11:00:26.600 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/37 file after the snapshot 2024-04-14T11:00:26.602 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/38 file after the snapshot 2024-04-14T11:00:26.604 INFO:tasks.workunit.client.0.smithi084.stdout: create 273/39 file after the snapshot 2024-04-14T11:00:26.605 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/.snap/snap-subdir-test 2024-04-14T11:00:26.618 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/30 file after the snapshot 2024-04-14T11:00:26.620 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/31 file after the snapshot 2024-04-14T11:00:26.622 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/32 file after the snapshot 2024-04-14T11:00:26.624 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/33 file after the snapshot 2024-04-14T11:00:26.626 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/34 file after the snapshot 2024-04-14T11:00:26.628 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/35 file after the snapshot 2024-04-14T11:00:26.629 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/36 file after the snapshot 2024-04-14T11:00:26.631 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/37 file after the snapshot 2024-04-14T11:00:26.633 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/38 file after the snapshot 2024-04-14T11:00:26.634 INFO:tasks.workunit.client.0.smithi084.stdout: create 274/39 file after the snapshot 2024-04-14T11:00:26.636 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/.snap/snap-subdir-test 2024-04-14T11:00:26.650 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/30 file after the snapshot 2024-04-14T11:00:26.651 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/31 file after the snapshot 2024-04-14T11:00:26.653 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/32 file after the snapshot 2024-04-14T11:00:26.655 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/33 file after the snapshot 2024-04-14T11:00:26.657 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/34 file after the snapshot 2024-04-14T11:00:26.658 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/35 file after the snapshot 2024-04-14T11:00:26.659 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/36 file after the snapshot 2024-04-14T11:00:26.661 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/37 file after the snapshot 2024-04-14T11:00:26.662 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/38 file after the snapshot 2024-04-14T11:00:26.664 INFO:tasks.workunit.client.0.smithi084.stdout: create 275/39 file after the snapshot 2024-04-14T11:00:26.666 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/.snap/snap-subdir-test 2024-04-14T11:00:26.681 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/30 file after the snapshot 2024-04-14T11:00:26.682 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/31 file after the snapshot 2024-04-14T11:00:26.684 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/32 file after the snapshot 2024-04-14T11:00:26.685 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/33 file after the snapshot 2024-04-14T11:00:26.687 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/34 file after the snapshot 2024-04-14T11:00:26.689 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/35 file after the snapshot 2024-04-14T11:00:26.691 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/36 file after the snapshot 2024-04-14T11:00:26.692 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/37 file after the snapshot 2024-04-14T11:00:26.694 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/38 file after the snapshot 2024-04-14T11:00:26.695 INFO:tasks.workunit.client.0.smithi084.stdout: create 276/39 file after the snapshot 2024-04-14T11:00:26.697 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/.snap/snap-subdir-test 2024-04-14T11:00:26.711 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/30 file after the snapshot 2024-04-14T11:00:26.713 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/31 file after the snapshot 2024-04-14T11:00:26.715 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/32 file after the snapshot 2024-04-14T11:00:26.717 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/33 file after the snapshot 2024-04-14T11:00:26.719 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/34 file after the snapshot 2024-04-14T11:00:26.721 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/35 file after the snapshot 2024-04-14T11:00:26.723 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/36 file after the snapshot 2024-04-14T11:00:26.725 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/37 file after the snapshot 2024-04-14T11:00:26.727 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/38 file after the snapshot 2024-04-14T11:00:26.729 INFO:tasks.workunit.client.0.smithi084.stdout: create 277/39 file after the snapshot 2024-04-14T11:00:26.731 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/.snap/snap-subdir-test 2024-04-14T11:00:26.744 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/30 file after the snapshot 2024-04-14T11:00:26.745 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/31 file after the snapshot 2024-04-14T11:00:26.747 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/32 file after the snapshot 2024-04-14T11:00:26.749 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/33 file after the snapshot 2024-04-14T11:00:26.751 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/34 file after the snapshot 2024-04-14T11:00:26.752 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/35 file after the snapshot 2024-04-14T11:00:26.754 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/36 file after the snapshot 2024-04-14T11:00:26.756 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/37 file after the snapshot 2024-04-14T11:00:26.758 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/38 file after the snapshot 2024-04-14T11:00:26.760 INFO:tasks.workunit.client.0.smithi084.stdout: create 278/39 file after the snapshot 2024-04-14T11:00:26.762 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/.snap/snap-subdir-test 2024-04-14T11:00:26.775 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/30 file after the snapshot 2024-04-14T11:00:26.776 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/31 file after the snapshot 2024-04-14T11:00:26.778 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/32 file after the snapshot 2024-04-14T11:00:26.780 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/33 file after the snapshot 2024-04-14T11:00:26.781 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/34 file after the snapshot 2024-04-14T11:00:26.782 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/35 file after the snapshot 2024-04-14T11:00:26.784 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/36 file after the snapshot 2024-04-14T11:00:26.808 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/37 file after the snapshot 2024-04-14T11:00:26.894 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/38 file after the snapshot 2024-04-14T11:00:26.896 INFO:tasks.workunit.client.0.smithi084.stdout: create 279/39 file after the snapshot 2024-04-14T11:00:26.897 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/.snap/snap-subdir-test 2024-04-14T11:00:26.941 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/30 file after the snapshot 2024-04-14T11:00:26.942 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/31 file after the snapshot 2024-04-14T11:00:26.944 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/32 file after the snapshot 2024-04-14T11:00:26.946 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/33 file after the snapshot 2024-04-14T11:00:26.947 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/34 file after the snapshot 2024-04-14T11:00:26.949 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/35 file after the snapshot 2024-04-14T11:00:26.951 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/36 file after the snapshot 2024-04-14T11:00:26.952 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/37 file after the snapshot 2024-04-14T11:00:26.954 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/38 file after the snapshot 2024-04-14T11:00:26.956 INFO:tasks.workunit.client.0.smithi084.stdout: create 280/39 file after the snapshot 2024-04-14T11:00:26.957 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/.snap/snap-subdir-test 2024-04-14T11:00:26.972 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/30 file after the snapshot 2024-04-14T11:00:26.974 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/31 file after the snapshot 2024-04-14T11:00:26.976 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/32 file after the snapshot 2024-04-14T11:00:26.977 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/33 file after the snapshot 2024-04-14T11:00:26.979 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/34 file after the snapshot 2024-04-14T11:00:26.981 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/35 file after the snapshot 2024-04-14T11:00:26.982 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/36 file after the snapshot 2024-04-14T11:00:26.984 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/37 file after the snapshot 2024-04-14T11:00:26.986 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/38 file after the snapshot 2024-04-14T11:00:26.987 INFO:tasks.workunit.client.0.smithi084.stdout: create 281/39 file after the snapshot 2024-04-14T11:00:26.989 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/.snap/snap-subdir-test 2024-04-14T11:00:27.001 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/30 file after the snapshot 2024-04-14T11:00:27.003 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/31 file after the snapshot 2024-04-14T11:00:27.005 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/32 file after the snapshot 2024-04-14T11:00:27.006 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/33 file after the snapshot 2024-04-14T11:00:27.008 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/34 file after the snapshot 2024-04-14T11:00:27.010 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/35 file after the snapshot 2024-04-14T11:00:27.011 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/36 file after the snapshot 2024-04-14T11:00:27.013 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/37 file after the snapshot 2024-04-14T11:00:27.014 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/38 file after the snapshot 2024-04-14T11:00:27.016 INFO:tasks.workunit.client.0.smithi084.stdout: create 282/39 file after the snapshot 2024-04-14T11:00:27.018 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/.snap/snap-subdir-test 2024-04-14T11:00:27.031 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/30 file after the snapshot 2024-04-14T11:00:27.033 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/31 file after the snapshot 2024-04-14T11:00:27.034 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/32 file after the snapshot 2024-04-14T11:00:27.036 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/33 file after the snapshot 2024-04-14T11:00:27.038 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/34 file after the snapshot 2024-04-14T11:00:27.040 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/35 file after the snapshot 2024-04-14T11:00:27.042 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/36 file after the snapshot 2024-04-14T11:00:27.043 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/37 file after the snapshot 2024-04-14T11:00:27.045 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/38 file after the snapshot 2024-04-14T11:00:27.047 INFO:tasks.workunit.client.0.smithi084.stdout: create 283/39 file after the snapshot 2024-04-14T11:00:27.049 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/.snap/snap-subdir-test 2024-04-14T11:00:27.062 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/30 file after the snapshot 2024-04-14T11:00:27.064 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/31 file after the snapshot 2024-04-14T11:00:27.066 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/32 file after the snapshot 2024-04-14T11:00:27.068 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/33 file after the snapshot 2024-04-14T11:00:27.070 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/34 file after the snapshot 2024-04-14T11:00:27.072 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/35 file after the snapshot 2024-04-14T11:00:27.074 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/36 file after the snapshot 2024-04-14T11:00:27.076 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/37 file after the snapshot 2024-04-14T11:00:27.077 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/38 file after the snapshot 2024-04-14T11:00:27.079 INFO:tasks.workunit.client.0.smithi084.stdout: create 284/39 file after the snapshot 2024-04-14T11:00:27.081 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/.snap/snap-subdir-test 2024-04-14T11:00:27.095 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/30 file after the snapshot 2024-04-14T11:00:27.096 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/31 file after the snapshot 2024-04-14T11:00:27.098 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/32 file after the snapshot 2024-04-14T11:00:27.100 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/33 file after the snapshot 2024-04-14T11:00:27.101 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/34 file after the snapshot 2024-04-14T11:00:27.104 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/35 file after the snapshot 2024-04-14T11:00:27.105 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/36 file after the snapshot 2024-04-14T11:00:27.107 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/37 file after the snapshot 2024-04-14T11:00:27.109 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/38 file after the snapshot 2024-04-14T11:00:27.111 INFO:tasks.workunit.client.0.smithi084.stdout: create 285/39 file after the snapshot 2024-04-14T11:00:27.113 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/.snap/snap-subdir-test 2024-04-14T11:00:27.126 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/30 file after the snapshot 2024-04-14T11:00:27.127 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/31 file after the snapshot 2024-04-14T11:00:27.129 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/32 file after the snapshot 2024-04-14T11:00:27.130 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/33 file after the snapshot 2024-04-14T11:00:27.132 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/34 file after the snapshot 2024-04-14T11:00:27.134 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/35 file after the snapshot 2024-04-14T11:00:27.135 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/36 file after the snapshot 2024-04-14T11:00:27.137 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/37 file after the snapshot 2024-04-14T11:00:27.139 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/38 file after the snapshot 2024-04-14T11:00:27.141 INFO:tasks.workunit.client.0.smithi084.stdout: create 286/39 file after the snapshot 2024-04-14T11:00:27.143 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/.snap/snap-subdir-test 2024-04-14T11:00:27.156 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/30 file after the snapshot 2024-04-14T11:00:27.158 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/31 file after the snapshot 2024-04-14T11:00:27.159 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/32 file after the snapshot 2024-04-14T11:00:27.161 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/33 file after the snapshot 2024-04-14T11:00:27.162 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/34 file after the snapshot 2024-04-14T11:00:27.164 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/35 file after the snapshot 2024-04-14T11:00:27.166 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/36 file after the snapshot 2024-04-14T11:00:27.168 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/37 file after the snapshot 2024-04-14T11:00:27.170 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/38 file after the snapshot 2024-04-14T11:00:27.172 INFO:tasks.workunit.client.0.smithi084.stdout: create 287/39 file after the snapshot 2024-04-14T11:00:27.173 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/.snap/snap-subdir-test 2024-04-14T11:00:27.187 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/30 file after the snapshot 2024-04-14T11:00:27.188 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/31 file after the snapshot 2024-04-14T11:00:27.190 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/32 file after the snapshot 2024-04-14T11:00:27.192 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/33 file after the snapshot 2024-04-14T11:00:27.194 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/34 file after the snapshot 2024-04-14T11:00:27.195 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/35 file after the snapshot 2024-04-14T11:00:27.197 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/36 file after the snapshot 2024-04-14T11:00:27.199 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/37 file after the snapshot 2024-04-14T11:00:27.200 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/38 file after the snapshot 2024-04-14T11:00:27.202 INFO:tasks.workunit.client.0.smithi084.stdout: create 288/39 file after the snapshot 2024-04-14T11:00:27.203 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/.snap/snap-subdir-test 2024-04-14T11:00:27.216 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/30 file after the snapshot 2024-04-14T11:00:27.217 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/31 file after the snapshot 2024-04-14T11:00:27.219 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/32 file after the snapshot 2024-04-14T11:00:27.221 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/33 file after the snapshot 2024-04-14T11:00:27.222 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/34 file after the snapshot 2024-04-14T11:00:27.224 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/35 file after the snapshot 2024-04-14T11:00:27.226 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/36 file after the snapshot 2024-04-14T11:00:27.228 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/37 file after the snapshot 2024-04-14T11:00:27.230 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/38 file after the snapshot 2024-04-14T11:00:27.232 INFO:tasks.workunit.client.0.smithi084.stdout: create 289/39 file after the snapshot 2024-04-14T11:00:27.233 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/.snap/snap-subdir-test 2024-04-14T11:00:27.247 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/30 file after the snapshot 2024-04-14T11:00:27.248 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/31 file after the snapshot 2024-04-14T11:00:27.251 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/32 file after the snapshot 2024-04-14T11:00:27.252 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/33 file after the snapshot 2024-04-14T11:00:27.254 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/34 file after the snapshot 2024-04-14T11:00:27.257 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/35 file after the snapshot 2024-04-14T11:00:27.259 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/36 file after the snapshot 2024-04-14T11:00:27.261 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/37 file after the snapshot 2024-04-14T11:00:27.262 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/38 file after the snapshot 2024-04-14T11:00:27.264 INFO:tasks.workunit.client.0.smithi084.stdout: create 290/39 file after the snapshot 2024-04-14T11:00:27.270 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/.snap/snap-subdir-test 2024-04-14T11:00:27.281 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/30 file after the snapshot 2024-04-14T11:00:27.282 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/31 file after the snapshot 2024-04-14T11:00:27.285 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/32 file after the snapshot 2024-04-14T11:00:27.286 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/33 file after the snapshot 2024-04-14T11:00:27.288 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/34 file after the snapshot 2024-04-14T11:00:27.289 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/35 file after the snapshot 2024-04-14T11:00:27.291 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/36 file after the snapshot 2024-04-14T11:00:27.292 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/37 file after the snapshot 2024-04-14T11:00:27.294 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/38 file after the snapshot 2024-04-14T11:00:27.296 INFO:tasks.workunit.client.0.smithi084.stdout: create 291/39 file after the snapshot 2024-04-14T11:00:27.297 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/.snap/snap-subdir-test 2024-04-14T11:00:27.311 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/30 file after the snapshot 2024-04-14T11:00:27.312 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/31 file after the snapshot 2024-04-14T11:00:27.314 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/32 file after the snapshot 2024-04-14T11:00:27.316 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/33 file after the snapshot 2024-04-14T11:00:27.318 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/34 file after the snapshot 2024-04-14T11:00:27.319 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/35 file after the snapshot 2024-04-14T11:00:27.321 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/36 file after the snapshot 2024-04-14T11:00:27.323 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/37 file after the snapshot 2024-04-14T11:00:27.324 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/38 file after the snapshot 2024-04-14T11:00:27.326 INFO:tasks.workunit.client.0.smithi084.stdout: create 292/39 file after the snapshot 2024-04-14T11:00:27.327 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/.snap/snap-subdir-test 2024-04-14T11:00:27.340 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/30 file after the snapshot 2024-04-14T11:00:27.342 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/31 file after the snapshot 2024-04-14T11:00:27.343 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/32 file after the snapshot 2024-04-14T11:00:27.345 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/33 file after the snapshot 2024-04-14T11:00:27.347 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/34 file after the snapshot 2024-04-14T11:00:27.348 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/35 file after the snapshot 2024-04-14T11:00:27.350 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/36 file after the snapshot 2024-04-14T11:00:27.352 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/37 file after the snapshot 2024-04-14T11:00:27.353 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/38 file after the snapshot 2024-04-14T11:00:27.355 INFO:tasks.workunit.client.0.smithi084.stdout: create 293/39 file after the snapshot 2024-04-14T11:00:27.357 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/.snap/snap-subdir-test 2024-04-14T11:00:27.370 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/30 file after the snapshot 2024-04-14T11:00:27.372 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/31 file after the snapshot 2024-04-14T11:00:27.374 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/32 file after the snapshot 2024-04-14T11:00:27.376 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/33 file after the snapshot 2024-04-14T11:00:27.378 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/34 file after the snapshot 2024-04-14T11:00:27.380 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/35 file after the snapshot 2024-04-14T11:00:27.382 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/36 file after the snapshot 2024-04-14T11:00:27.383 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/37 file after the snapshot 2024-04-14T11:00:27.385 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/38 file after the snapshot 2024-04-14T11:00:27.386 INFO:tasks.workunit.client.0.smithi084.stdout: create 294/39 file after the snapshot 2024-04-14T11:00:27.388 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/.snap/snap-subdir-test 2024-04-14T11:00:27.401 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/30 file after the snapshot 2024-04-14T11:00:27.402 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/31 file after the snapshot 2024-04-14T11:00:27.404 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/32 file after the snapshot 2024-04-14T11:00:27.406 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/33 file after the snapshot 2024-04-14T11:00:27.408 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/34 file after the snapshot 2024-04-14T11:00:27.410 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/35 file after the snapshot 2024-04-14T11:00:27.411 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/36 file after the snapshot 2024-04-14T11:00:27.413 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/37 file after the snapshot 2024-04-14T11:00:27.415 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/38 file after the snapshot 2024-04-14T11:00:27.416 INFO:tasks.workunit.client.0.smithi084.stdout: create 295/39 file after the snapshot 2024-04-14T11:00:27.418 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/.snap/snap-subdir-test 2024-04-14T11:00:27.430 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/30 file after the snapshot 2024-04-14T11:00:27.433 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/31 file after the snapshot 2024-04-14T11:00:27.434 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/32 file after the snapshot 2024-04-14T11:00:27.436 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/33 file after the snapshot 2024-04-14T11:00:27.438 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/34 file after the snapshot 2024-04-14T11:00:27.439 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/35 file after the snapshot 2024-04-14T11:00:27.441 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/36 file after the snapshot 2024-04-14T11:00:27.443 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/37 file after the snapshot 2024-04-14T11:00:27.445 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/38 file after the snapshot 2024-04-14T11:00:27.447 INFO:tasks.workunit.client.0.smithi084.stdout: create 296/39 file after the snapshot 2024-04-14T11:00:27.449 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/.snap/snap-subdir-test 2024-04-14T11:00:27.462 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/30 file after the snapshot 2024-04-14T11:00:27.464 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/31 file after the snapshot 2024-04-14T11:00:27.466 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/32 file after the snapshot 2024-04-14T11:00:27.467 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/33 file after the snapshot 2024-04-14T11:00:27.469 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/34 file after the snapshot 2024-04-14T11:00:27.470 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/35 file after the snapshot 2024-04-14T11:00:27.472 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/36 file after the snapshot 2024-04-14T11:00:27.474 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/37 file after the snapshot 2024-04-14T11:00:27.476 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/38 file after the snapshot 2024-04-14T11:00:27.477 INFO:tasks.workunit.client.0.smithi084.stdout: create 297/39 file after the snapshot 2024-04-14T11:00:27.479 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/.snap/snap-subdir-test 2024-04-14T11:00:27.492 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/30 file after the snapshot 2024-04-14T11:00:27.493 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/31 file after the snapshot 2024-04-14T11:00:27.495 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/32 file after the snapshot 2024-04-14T11:00:27.496 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/33 file after the snapshot 2024-04-14T11:00:27.498 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/34 file after the snapshot 2024-04-14T11:00:27.500 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/35 file after the snapshot 2024-04-14T11:00:27.501 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/36 file after the snapshot 2024-04-14T11:00:27.503 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/37 file after the snapshot 2024-04-14T11:00:27.505 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/38 file after the snapshot 2024-04-14T11:00:27.506 INFO:tasks.workunit.client.0.smithi084.stdout: create 298/39 file after the snapshot 2024-04-14T11:00:27.508 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/.snap/snap-subdir-test 2024-04-14T11:00:27.522 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/30 file after the snapshot 2024-04-14T11:00:27.523 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/31 file after the snapshot 2024-04-14T11:00:27.524 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/32 file after the snapshot 2024-04-14T11:00:27.526 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/33 file after the snapshot 2024-04-14T11:00:27.528 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/34 file after the snapshot 2024-04-14T11:00:27.529 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/35 file after the snapshot 2024-04-14T11:00:27.531 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/36 file after the snapshot 2024-04-14T11:00:27.533 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/37 file after the snapshot 2024-04-14T11:00:27.535 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/38 file after the snapshot 2024-04-14T11:00:27.536 INFO:tasks.workunit.client.0.smithi084.stdout: create 299/39 file after the snapshot 2024-04-14T11:00:27.538 INFO:tasks.workunit.client.0.smithi084.stdout:Take second snapshot .snap/test2 2024-04-14T11:00:27.679 INFO:tasks.workunit.client.0.smithi084.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-04-14T11:00:28.944 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-04-14T11:00:28.945 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-04-14T11:00:28.946 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-04-14T11:00:28.947 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-04-14T11:00:28.948 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-04-14T11:00:28.949 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-04-14T11:00:29.480 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-04-14T11:00:29.481 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-04-14T11:00:29.482 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-04-14T11:00:29.483 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-04-14T11:00:29.484 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-04-14T11:00:29.485 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-04-14T11:00:30.065 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-04-14T11:00:30.065 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-04-14T11:00:30.065 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-04-14T11:00:30.065 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-04-14T11:00:30.065 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-04-14T11:00:30.066 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-04-14T11:00:30.067 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-04-14T11:00:30.068 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-04-14T11:00:30.069 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-04-14T11:00:30.070 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-04-14T11:00:30.566 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-04-14T11:00:30.566 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-04-14T11:00:30.567 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-04-14T11:00:30.568 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-04-14T11:00:30.569 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-04-14T11:00:30.570 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-04-14T11:00:30.571 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-04-14T11:00:30.572 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-04-14T11:00:30.572 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-04-14T11:00:30.572 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-04-14T11:00:31.231 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-04-14T11:00:31.232 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-04-14T11:00:31.233 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-04-14T11:00:31.234 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-04-14T11:00:31.235 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-04-14T11:00:31.236 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-04-14T11:00:31.748 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-04-14T11:00:31.749 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-04-14T11:00:31.750 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-04-14T11:00:31.751 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-04-14T11:00:31.752 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-04-14T11:00:31.753 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-04-14T11:00:32.453 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-04-14T11:00:32.454 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-04-14T11:00:32.455 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-04-14T11:00:32.456 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-04-14T11:00:32.457 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-04-14T11:00:32.458 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-04-14T11:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-04-14T11:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-04-14T11:00:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-04-14T11:00:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-04-14T11:00:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-04-14T11:00:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-04-14T11:00:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-04-14T11:00:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-04-14T11:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-04-14T11:00:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-04-14T11:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-04-14T11:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-04-14T11:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-04-14T11:00:33.626 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-04-14T11:00:33.627 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-04-14T11:00:33.628 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-04-14T11:00:33.629 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-04-14T11:00:33.630 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-04-14T11:00:33.631 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-04-14T11:00:33.938 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:00:33.941 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:00:34.185 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-04-14T11:00:34.186 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-04-14T11:00:34.187 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-04-14T11:00:34.188 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-04-14T11:00:34.189 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-04-14T11:00:34.190 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-04-14T11:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-04-14T11:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-04-14T11:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-04-14T11:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-04-14T11:00:34.191 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-04-14T11:00:34.867 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-04-14T11:00:34.868 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-04-14T11:00:34.869 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-04-14T11:00:34.870 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-04-14T11:00:34.871 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-04-14T11:00:34.872 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-04-14T11:00:35.428 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-04-14T11:00:35.429 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-04-14T11:00:35.430 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-04-14T11:00:35.431 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-04-14T11:00:35.432 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-04-14T11:00:35.433 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-04-14T11:00:35.980 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-04-14T11:00:35.981 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-04-14T11:00:35.982 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-04-14T11:00:35.983 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-04-14T11:00:35.984 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-04-14T11:00:35.985 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-04-14T11:00:35.986 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-04-14T11:00:35.986 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-04-14T11:00:35.986 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-04-14T11:00:35.986 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-04-14T11:00:35.986 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-04-14T11:00:36.247 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.4) is longer than `split_if_longer` (35.0),will split into two consecutive quiesces 2024-04-14T11:00:36.247 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.7 2024-04-14T11:00:36.248 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T11:00:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.364+0000 7f07aa2c8640 1 Processor -- start 2024-04-14T11:00:36.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.364+0000 7f07aa2c8640 1 -- start start 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07aa2c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07aa2c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f07a406f0d0 0x7f07a415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07aa2c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07a415cc30 0x7f07a40ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07aa2c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f07a40c33b0 con 0x7f07a415cc30 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07aa2c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f07a40c3ea0 con 0x7f07a406f0d0 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07aa2c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f07a40c3600 con 0x7f07a4152f10 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07a415cc30 0x7f07a40ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f07a406f0d0 0x7f07a415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f07a415cc30 0x7f07a40ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33018/0 (socket says 172.21.15.84:33018) 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 -- 172.21.15.84:0/1069879652 learned_addr learned my addr 172.21.15.84:0/1069879652 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a3fff640 1 --2- 172.21.15.84:0/1069879652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 -- 172.21.15.84:0/1069879652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 msgr2=0x7f07a41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 --2- 172.21.15.84:0/1069879652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 -- 172.21.15.84:0/1069879652 >> v2:172.21.15.175:3300/0 conn(0x7f07a406f0d0 msgr2=0x7f07a415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 --2- 172.21.15.84:0/1069879652 >> v2:172.21.15.175:3300/0 conn(0x7f07a406f0d0 0x7f07a415c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.365+0000 7f07a8865640 1 -- 172.21.15.84:0/1069879652 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a40c38e0 con 0x7f07a415cc30 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.366+0000 7f07a8865640 1 --2- 172.21.15.84:0/1069879652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a40ce300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f07a4072610 tx=0x7f079c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c6d9403aaa4533 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.366+0000 7f07a2ffd640 1 -- 172.21.15.84:0/1069879652 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c02ca70 con 0x7f07a415cc30 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.366+0000 7f07a2ffd640 1 -- 172.21.15.84:0/1069879652 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c02cc10 con 0x7f07a415cc30 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.366+0000 7f07a2ffd640 1 -- 172.21.15.84:0/1069879652 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c0343f0 con 0x7f07a415cc30 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 -- 172.21.15.84:0/1069879652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 msgr2=0x7f07a40ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/1069879652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a40ce300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f07a4072610 tx=0x7f079c02bed0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 -- 172.21.15.84:0/1069879652 shutdown_connections 2024-04-14T11:00:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/1069879652 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a40ce300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/1069879652 >> v2:172.21.15.175:3300/0 conn(0x7f07a406f0d0 0x7f07a415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/1069879652 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 -- 172.21.15.84:0/1069879652 >> 172.21.15.84:0/1069879652 conn(0x7f07a406db10 msgr2=0x7f07a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 -- 172.21.15.84:0/1069879652 shutdown_connections 2024-04-14T11:00:36.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.367+0000 7f07aa2c8640 1 -- 172.21.15.84:0/1069879652 wait complete. 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.368+0000 7f07aa2c8640 1 Processor -- start 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.368+0000 7f07aa2c8640 1 -- start start 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07aa2c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a406f0d0 0x7f07a40ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07aa2c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a40c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07aa2c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a41eea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07aa2c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f07a40700a0 con 0x7f07a415cc30 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07aa2c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f07a415c1d0 con 0x7f07a406f0d0 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07aa2c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f07a406fbd0 con 0x7f07a4152f10 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07a8865640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a41eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07a8865640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a41eea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33034/0 (socket says 172.21.15.84:33034) 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07a8865640 1 -- 172.21.15.84:0/3930243674 learned_addr learned my addr 172.21.15.84:0/3930243674 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07a3fff640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a406f0d0 0x7f07a40ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.369+0000 7f07a37fe640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a40c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a8865640 1 -- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 msgr2=0x7f07a40c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a8865640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a40c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a8865640 1 -- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a406f0d0 msgr2=0x7f07a40ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a8865640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a406f0d0 0x7f07a40ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a8865640 1 -- 172.21.15.84:0/3930243674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a4155140 con 0x7f07a415cc30 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a37fe640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a40c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a3fff640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a406f0d0 0x7f07a40ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a8865640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a41eea80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f079c009f40 tx=0x7f079c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c044020 con 0x7f07a415cc30 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c040670 con 0x7f07a415cc30 2024-04-14T11:00:36.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a4153510 con 0x7f07a415cc30 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c009510 con 0x7f07a415cc30 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.370+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a4153ad0 con 0x7f07a415cc30 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.371+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a40760d0 con 0x7f07a415cc30 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.372+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f079c047020 con 0x7f07a415cc30 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.372+0000 7f07a0ff9640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f079006c8f0 0x7f079006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.372+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f079c0ae400 con 0x7f07a415cc30 2024-04-14T11:00:36.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.372+0000 7f07a3fff640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f079006c8f0 0x7f079006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.373+0000 7f07a3fff640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f079006c8f0 0x7f079006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0794009e90 tx=0x7f0794009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.377+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f07a40760d0 con 0x7f07a415cc30 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-04-14T11:00:36.513 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-04-14T11:00:36.514 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-04-14T11:00:36.515 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-04-14T11:00:36.516 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-04-14T11:00:36.517 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-04-14T11:00:36.518 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-04-14T11:00:36.519 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-04-14T11:00:36.519 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-04-14T11:00:36.519 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-04-14T11:00:36.519 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-04-14T11:00:36.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.628+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07a4069c30 con 0x7f07a415cc30 2024-04-14T11:00:36.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.628+0000 7f07a0ff9640 1 -- 172.21.15.84:0/3930243674 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7f079c04e030 con 0x7f07a415cc30 2024-04-14T11:00:36.627 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:00:36.627 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T11:00:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T11:00:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f079006c8f0 msgr2=0x7f079006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f079006c8f0 0x7f079006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0794009e90 tx=0x7f0794009190 comp rx=0 tx=0).stop 2024-04-14T11:00:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 msgr2=0x7f07a41eea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a41eea80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f079c009f40 tx=0x7f079c004a40 comp rx=0 tx=0).stop 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 shutdown_connections 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f079006c8f0 0x7f079006edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07a415cc30 0x7f07a41eea80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07a4152f10 0x7f07a40c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 --2- 172.21.15.84:0/3930243674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07a406f0d0 0x7f07a40ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.630+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 >> 172.21.15.84:0/3930243674 conn(0x7f07a406db10 msgr2=0x7f07a406def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.631+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 shutdown_connections 2024-04-14T11:00:36.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.631+0000 7f07aa2c8640 1 -- 172.21.15.84:0/3930243674 wait complete. 2024-04-14T11:00:36.638 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4308 quiesce db / --timeout 30 --expiration 80.7 --await' 2024-04-14T11:00:36.638 DEBUG:teuthology.orchestra.run.smithi084:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4308 quiesce db / --timeout 30 --expiration 80.7 --await 2024-04-14T11:00:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.762+0000 7f1dc1c08640 1 Processor -- start 2024-04-14T11:00:36.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dc1c08640 1 -- start start 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dc1c08640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dbc06b900 0x7f1dbc06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dc1c08640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1dbc070ed0 0x7f1dbc15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dc1c08640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc0c8820 con 0x7f1dbc155110 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dc1c08640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f1dbc06c350 con 0x7f1dbc06b900 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dc1c08640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1dbc0c8b00 con 0x7f1dbc070ed0 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.763+0000 7f1dbaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dbc06b900 0x7f1dbc06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f1dbc06b900 0x7f1dbc06be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33036/0 (socket says 172.21.15.84:33036) 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 -- 172.21.15.84:0/121167715 learned_addr learned my addr 172.21.15.84:0/121167715 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/121167715 >> v2:172.21.15.175:3300/0 conn(0x7f1dbc070ed0 0x7f1dbc15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 -- 172.21.15.84:0/121167715 >> v2:172.21.15.175:3300/0 conn(0x7f1dbc070ed0 msgr2=0x7f1dbc15afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/121167715 >> v2:172.21.15.175:3300/0 conn(0x7f1dbc070ed0 0x7f1dbc15afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 -- 172.21.15.84:0/121167715 >> v1:172.21.15.175:6789/0 conn(0x7f1dbc155110 legacy=0x7f1dbc06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 -- 172.21.15.84:0/121167715 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc0c8de0 con 0x7f1dbc06b900 2024-04-14T11:00:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.764+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/121167715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc06b900 0x7f1dbc06be10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d24cfe22329f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dba7fc640 1 -- 172.21.15.84:0/121167715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0034070 con 0x7f1dbc06b900 2024-04-14T11:00:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dba7fc640 1 -- 172.21.15.84:0/121167715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0030860 con 0x7f1dbc06b900 2024-04-14T11:00:36.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dba7fc640 1 -- 172.21.15.84:0/121167715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0030c30 con 0x7f1dbc06b900 2024-04-14T11:00:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 -- 172.21.15.84:0/121167715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc06b900 msgr2=0x7f1dbc06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/121167715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc06b900 0x7f1dbc06be10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db002b9a0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 -- 172.21.15.84:0/121167715 shutdown_connections 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/121167715 >> v2:172.21.15.175:3300/0 conn(0x7f1dbc070ed0 0x7f1dbc15afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/121167715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc06b900 0x7f1dbc06be10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 -- 172.21.15.84:0/121167715 >> 172.21.15.84:0/121167715 conn(0x7f1dbc0cd370 msgr2=0x7f1dbc0cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 -- 172.21.15.84:0/121167715 shutdown_connections 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.765+0000 7f1dc1c08640 1 -- 172.21.15.84:0/121167715 wait complete. 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.766+0000 7f1dc1c08640 1 Processor -- start 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 -- start start 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dbc06b900 0x7f1dbc1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dbc070ed0 0x7f1dbc1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 0x7f1dbc1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc06c570 con 0x7f1dbc155110 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc0c93a0 con 0x7f1dbc070ed0 2024-04-14T11:00:36.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dc1c08640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1dbc06d110 con 0x7f1dbc06b900 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 0x7f1dbc1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 0x7f1dbc1f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33048/0 (socket says 172.21.15.84:33048) 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3910568415 learned_addr learned my addr 172.21.15.84:0/3910568415 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.767+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dbc070ed0 0x7f1dbc1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dbc06b900 0x7f1dbc1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dbc06b900 msgr2=0x7f1dbc1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dbc06b900 0x7f1dbc1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dbc070ed0 msgr2=0x7f1dbc1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dbc070ed0 0x7f1dbc1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3910568415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc15a800 con 0x7f1dbc155110 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 0x7f1dbc1f2510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1db400efc0 tx=0x7f1db400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1da3fff640 1 -- 172.21.15.84:0/3910568415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4018020 con 0x7f1dbc155110 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1da3fff640 1 -- 172.21.15.84:0/3910568415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4014480 con 0x7f1dbc155110 2024-04-14T11:00:36.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1da3fff640 1 -- 172.21.15.84:0/3910568415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4014870 con 0x7f1dbc155110 2024-04-14T11:00:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc0cabf0 con 0x7f1dbc155110 2024-04-14T11:00:36.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.768+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc0ca930 con 0x7f1dbc155110 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.770+0000 7f1da3fff640 1 -- 172.21.15.84:0/3910568415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1db4005d10 con 0x7f1dbc155110 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.770+0000 7f1da3fff640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1da806c8f0 0x7f1da806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.771+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1da806c8f0 0x7f1da806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.771+0000 7f1da3fff640 1 -- 172.21.15.84:0/3910568415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f1db408c5c0 con 0x7f1dbc155110 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.771+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1da806c8f0 0x7f1da806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1dac001780 tx=0x7f1dac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.771+0000 7f1dc49f1740 1 Processor -- start 2024-04-14T11:00:36.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.771+0000 7f1dc49f1740 1 -- start start 2024-04-14T11:00:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 0x56149af38f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af37090 0x56149af77e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56149ae9d040 con 0x56149af824b0 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56149ae43a70 con 0x56149af38630 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56149ae99000 con 0x56149af37090 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.772+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 0x56149af38f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 0x56149af38f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33058/0 (socket says 172.21.15.84:33058) 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 -- 172.21.15.84:0/1858103585 learned_addr learned my addr 172.21.15.84:0/1858103585 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af37090 0x56149af77e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 -- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af37090 msgr2=0x56149af77e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af37090 0x56149af77e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 -- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 msgr2=0x56149af38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af38a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 -- 172.21.15.84:0/1858103585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149ac7bc90 con 0x56149af824b0 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 0x56149af38f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1db002b9e0 tx=0x7f1db0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db1f7d10742ebb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1da17fa640 1 -- 172.21.15.84:0/1858103585 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0034040 con 0x56149af824b0 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1da17fa640 1 -- 172.21.15.84:0/1858103585 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0048070 con 0x56149af824b0 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.773+0000 7f1da17fa640 1 -- 172.21.15.84:0/1858103585 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0030d60 con 0x56149af824b0 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 -- 172.21.15.84:0/1858103585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 msgr2=0x56149af38f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 0x56149af38f50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1db002b9e0 tx=0x7f1db0008030 comp rx=0 tx=0).stop 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 -- 172.21.15.84:0/1858103585 shutdown_connections 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af37090 0x56149af77e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af824b0 0x56149af38f50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/1858103585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 -- 172.21.15.84:0/1858103585 >> 172.21.15.84:0/1858103585 conn(0x56149af34da0 msgr2=0x56149af376e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 -- 172.21.15.84:0/1858103585 shutdown_connections 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.774+0000 7f1dc49f1740 1 -- 172.21.15.84:0/1858103585 wait complete. 2024-04-14T11:00:36.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 -- start start 2024-04-14T11:00:36.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 Processor -- start 2024-04-14T11:00:36.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af5f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149af60590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af82980 0x56149af60ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56149af5db90 con 0x56149af82980 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x56149ae56e30 con 0x56149af38630 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x56149af35f50 con 0x56149af824b0 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dc49f1740 10 client.0 _ll_register_callbacks cb 0x56149ae23810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.775+0000 7f1dbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af82980 0x56149af60ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af5f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149af60590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbb7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af5f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:40890/0 (socket says 172.21.15.84:40890) 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbb7fe640 1 -- 172.21.15.84:0/3230804685 learned_addr learned my addr 172.21.15.84:0/3230804685 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 msgr2=0x56149af60590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149af60590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 msgr2=0x56149af5f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af5f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbbfff640 1 -- 172.21.15.84:0/3230804685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149acdc420 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149af60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af82980 0x56149af60ad0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1db408a9d0 tx=0x7f1db405a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddff564cd4fbcd76 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1d9a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3230804685 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4059900 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3230804685 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f1db408c0b0 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1db0048070 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3230804685 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f1db4058670 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dc49f1740 10 client.4989 fetch_fsmap learned FSMap version 13 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56149ab6f580 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.776+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3230804685 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0048070 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3230804685 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f1db4073cd0 con 0x56149af82980 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dc49f1740 10 client.4989 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dc49f1740 10 client.4989 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dc49f1740 20 client.4989 populate_metadata read hostname 'smithi084' 2024-04-14T11:00:36.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af5d4b0 0x56149af8c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dc49f1740 4 client.4989 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56149aeaaa60 con 0x56149af5d4b0 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af5d4b0 0x56149af8c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1d9a7fc640 10 client.4989 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.777+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af5d4b0 0x56149af8c770 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36053fe26e24 server_cookie=585233d5984a9d68 in_seq=0 out_seq=0 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.778+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3230804685 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56149aeaaa60 con 0x56149af5d4b0 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.778+0000 7f1d9a7fc640 10 client.4989 handle_command_reply: tid=0 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 client.4989 shutdown 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af82980 msgr2=0x56149af60ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af82980 0x56149af60ad0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1db408a9d0 tx=0x7f1db405a430 comp rx=0 tx=0).stop 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 shutdown_connections 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af5d4b0 0x56149af8c770 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af82980 0x56149af60ad0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1d9a7fc640 0 client.4989 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:00:36.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149af60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3230804685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af5f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 >> 172.21.15.84:0/3230804685 conn(0x56149af37090 msgr2=0x56149af31ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:36.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 shutdown_connections 2024-04-14T11:00:36.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3230804685 wait complete. 2024-04-14T11:00:36.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.779+0000 7f1dc49f1740 20 client.4989 trim_cache size 0 max 16384 2024-04-14T11:00:36.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.798+0000 7f1dc49f1740 1 Processor -- start 2024-04-14T11:00:36.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 -- start start 2024-04-14T11:00:36.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af38630 0x56149af60590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149af60ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af824b0 0x56149af75870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1fe400 con 0x56149af5d4b0 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1fd660 con 0x56149af824b0 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.799+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1dbc1fdd30 con 0x56149af38630 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149af60ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149af60ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33070/0 (socket says 172.21.15.84:33070) 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3536882581 learned_addr learned my addr 172.21.15.84:0/3536882581 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af824b0 0x56149af75870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af38630 0x56149af60590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af38630 msgr2=0x56149af60590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af38630 0x56149af60590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af824b0 msgr2=0x56149af75870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af824b0 0x56149af75870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3536882581 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149af5f830 con 0x56149af5d4b0 2024-04-14T11:00:36.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149af60ad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1db0045040 tx=0x7f1db0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9623c842b5d491eb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1da0ff9640 1 -- 172.21.15.84:0/3536882581 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0051070 con 0x56149af5d4b0 2024-04-14T11:00:36.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1da0ff9640 1 -- 172.21.15.84:0/3536882581 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0048040 con 0x56149af5d4b0 2024-04-14T11:00:36.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.800+0000 7f1da0ff9640 1 -- 172.21.15.84:0/3536882581 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0034040 con 0x56149af5d4b0 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3536882581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 msgr2=0x56149af60ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149af60ad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1db0045040 tx=0x7f1db0030000 comp rx=0 tx=0).stop 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3536882581 shutdown_connections 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af824b0 0x56149af75870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149af60ad0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3536882581 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af38630 0x56149af60590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3536882581 >> 172.21.15.84:0/3536882581 conn(0x56149af37090 msgr2=0x56149af5ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3536882581 shutdown_connections 2024-04-14T11:00:36.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.801+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3536882581 wait complete. 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 -- start start 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 Processor -- start 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149aff3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149afecd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1f4270 con 0x56149af5d4b0 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc1fc610 con 0x56149af38630 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1dbc1f48c0 con 0x56149af824b0 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dc49f1740 10 client.0 _ll_register_callbacks cb 0x7f1db4004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.802+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149aff3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149aff3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33080/0 (socket says 172.21.15.84:33080) 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3444630775 learned_addr learned my addr 172.21.15.84:0/3444630775 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbbfff640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149afecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 msgr2=0x56149afecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149afecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 msgr2=0x56149af367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 -- 172.21.15.84:0/3444630775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149af766e0 con 0x56149af5d4b0 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dbaffd640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149aff3060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd075e2a095418f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1d9a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:00:36.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3444630775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0034040 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3444630775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f1db0030da0 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1db0048040 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3444630775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f1db0063050 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dc49f1740 10 client.4995 fetch_fsmap learned FSMap version 13 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x56149af37680 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.803+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3444630775 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0048040 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3444630775 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f1db0066020 con 0x56149af5d4b0 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dc49f1740 10 client.4995 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dc49f1740 10 client.4995 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dc49f1740 20 client.4995 populate_metadata read hostname 'smithi084' 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af82980 0x56149afed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:36.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dc49f1740 4 client.4995 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.7, "await": true}] 2024-04-14T11:00:36.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.7, "await": true}) -- 0x56149aea48d0 con 0x56149af82980 2024-04-14T11:00:36.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af82980 0x56149afed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:36.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1d9a7fc640 10 client.4995 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:00:36.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:36.804+0000 7f1dbb7fe640 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af82980 0x56149afed2c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b21a43836c269264 server_cookie=ba4b9f528c6611a1 in_seq=0 out_seq=0 2024-04-14T11:00:38.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1d9a7fc640 1 -- 172.21.15.84:0/3444630775 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x56149aea48d0 con 0x56149af82980 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1d9a7fc640 10 client.4995 handle_command_reply: tid=0 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 client.4995 shutdown 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 msgr2=0x56149aff3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149aff3060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009870 tx=0x7f1db0004730 comp rx=0 tx=0).stop 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 shutdown_connections 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x56149af82980 0x56149afed2c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x56149af824b0 0x56149afecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56149af5d4b0 0x56149aff3060 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 --2- 172.21.15.84:0/3444630775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56149af38630 0x56149af367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1d9a7fc640 0 client.4995 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:00:38.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 >> 172.21.15.84:0/3444630775 conn(0x56149af37090 msgr2=0x56149af730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 shutdown_connections 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 1 -- 172.21.15.84:0/3444630775 wait complete. 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.985+0000 7f1dc49f1740 20 client.4995 trim_cache size 0 max 16384 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 13, 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 4308, 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 2, 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "cc22936a": { 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 2, 2024-04-14T11:00:38.983 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 30.0, 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 80.7, 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:00:38.984 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:00:38.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:00:38.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:00:38.985 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T11:00:38.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1da806c8f0 msgr2=0x7f1da806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1da806c8f0 0x7f1da806edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1dac001780 tx=0x7f1dac009040 comp rx=0 tx=0).stop 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 msgr2=0x7f1dbc1f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 0x7f1dbc1f2510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1db400efc0 tx=0x7f1db400c490 comp rx=0 tx=0).stop 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 shutdown_connections 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1da806c8f0 0x7f1da806edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1dbc155110 0x7f1dbc1f2510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dbc070ed0 0x7f1dbc1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 --2- 172.21.15.84:0/3910568415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dbc06b900 0x7f1dbc1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 >> 172.21.15.84:0/3910568415 conn(0x7f1dbc0cd370 msgr2=0x7f1dbc152e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 shutdown_connections 2024-04-14T11:00:38.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:38.986+0000 7f1dc1c08640 1 -- 172.21.15.84:0/3910568415 wait complete. 2024-04-14T11:00:38.992 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: cc22936a, quiesce duration: 20.7 2024-04-14T11:00:59.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T11:00:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.811+0000 7faaa5c36640 1 Processor -- start 2024-04-14T11:00:59.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.811+0000 7faaa5c36640 1 -- start start 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faaa5c36640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faaa006faf0 0x7faaa006ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faaa5c36640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa0070480 con 0x7faaa01585d0 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faaa5c36640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa00c77a0 con 0x7faaa015bdc0 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faaa5c36640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7faaa00c8ba0 con 0x7faaa006faf0 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7faaa006faf0 0x7faaa006ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7faaa01585d0 0x7faaa00c8060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41778/0 (socket says 172.21.15.84:41778) 2024-04-14T11:00:59.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9f7fe640 1 -- 172.21.15.84:0/3837295887 learned_addr learned my addr 172.21.15.84:0/3837295887 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:00:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9ffff640 1 -- 172.21.15.84:0/3837295887 >> v1:172.21.15.175:6789/0 conn(0x7faaa015bdc0 legacy=0x7faaa006e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9ffff640 1 -- 172.21.15.84:0/3837295887 >> v1:172.21.15.84:6789/0 conn(0x7faaa01585d0 legacy=0x7faaa00c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9ffff640 1 -- 172.21.15.84:0/3837295887 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa00c7a80 con 0x7faaa006faf0 2024-04-14T11:00:59.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.812+0000 7faa9e7fc640 1 -- 172.21.15.84:0/3837295887 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995468460 0 0) 0x7faaa0070480 con 0x7faaa01585d0 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.813+0000 7faa9ffff640 1 --2- 172.21.15.84:0/3837295887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa006faf0 0x7faaa006ff40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa98009d90 tx=0x7faa9802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd924c7da9716611 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.813+0000 7faa9e7fc640 1 -- 172.21.15.84:0/3837295887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98039070 con 0x7faaa006faf0 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.813+0000 7faa9e7fc640 1 -- 172.21.15.84:0/3837295887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9802cc60 con 0x7faaa006faf0 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.813+0000 7faa9e7fc640 1 -- 172.21.15.84:0/3837295887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98034660 con 0x7faaa006faf0 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 -- 172.21.15.84:0/3837295887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa006faf0 msgr2=0x7faaa006ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 --2- 172.21.15.84:0/3837295887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa006faf0 0x7faaa006ff40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa98009d90 tx=0x7faa9802beb0 comp rx=0 tx=0).stop 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 -- 172.21.15.84:0/3837295887 shutdown_connections 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 --2- 172.21.15.84:0/3837295887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa006faf0 0x7faaa006ff40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 -- 172.21.15.84:0/3837295887 >> 172.21.15.84:0/3837295887 conn(0x7faaa00ccd20 msgr2=0x7faaa00cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:00:59.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 -- 172.21.15.84:0/3837295887 shutdown_connections 2024-04-14T11:00:59.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.814+0000 7faaa5c36640 1 -- 172.21.15.84:0/3837295887 wait complete. 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.815+0000 7faaa5c36640 1 Processor -- start 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.815+0000 7faaa5c36640 1 -- start start 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faaa5c36640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa006faf0 0x7faaa00c01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faaa5c36640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa01585d0 0x7faaa00ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faaa5c36640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 0x7faaa00c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faaa5c36640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00c8770 con 0x7faaa015bdc0 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faaa5c36640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00c90d0 con 0x7faaa01585d0 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faaa5c36640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faaa00c7440 con 0x7faaa006faf0 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 0x7faaa00c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 0x7faaa00c6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36120/0 (socket says 172.21.15.84:36120) 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 -- 172.21.15.84:0/1594833615 learned_addr learned my addr 172.21.15.84:0/1594833615 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:00:59.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9effd640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa01585d0 0x7faaa00ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9f7fe640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa006faf0 0x7faaa00c01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 -- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa006faf0 msgr2=0x7faaa00c01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa006faf0 0x7faaa00c01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 -- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa01585d0 msgr2=0x7faaa00ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa01585d0 0x7faaa00ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.816+0000 7faa9ffff640 1 -- 172.21.15.84:0/1594833615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa015afc0 con 0x7faaa015bdc0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.817+0000 7faa9ffff640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 0x7faaa00c6120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faa98037040 tx=0x7faa98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.817+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98044020 con 0x7faaa015bdc0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.817+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9803a040 con 0x7faaa015bdc0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.817+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa98039050 con 0x7faaa015bdc0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.817+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa01f0b80 con 0x7faaa015bdc0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.817+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa015b560 con 0x7faaa015bdc0 2024-04-14T11:00:59.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.818+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa01f0990 con 0x7faaa015bdc0 2024-04-14T11:00:59.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.818+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa9802cae0 con 0x7faaa015bdc0 2024-04-14T11:00:59.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.819+0000 7faa87fff640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7faa8c06c8f0 0x7faa8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:00:59.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.819+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7faa980ae190 con 0x7faaa015bdc0 2024-04-14T11:00:59.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.819+0000 7faa9f7fe640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7faa8c06c8f0 0x7faa8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:00:59.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.819+0000 7faa9f7fe640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7faa8c06c8f0 0x7faa8c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa90007f70 tx=0x7faa90007f00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:00:59.818 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:00:59.823+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7faa9804e060 con 0x7faaa015bdc0 2024-04-14T11:01:00.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.036+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaa0069c30 con 0x7faaa015bdc0 2024-04-14T11:01:00.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.037+0000 7faa87fff640 1 -- 172.21.15.84:0/1594833615 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7faa9807bf10 con 0x7faaa015bdc0 2024-04-14T11:01:00.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:01:00.032 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T11:01:00.032 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7faa8c06c8f0 msgr2=0x7faa8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7faa8c06c8f0 0x7faa8c06edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faa90007f70 tx=0x7faa90007f00 comp rx=0 tx=0).stop 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 msgr2=0x7faaa00c6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 0x7faaa00c6120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7faa98037040 tx=0x7faa98004a40 comp rx=0 tx=0).stop 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 shutdown_connections 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7faa8c06c8f0 0x7faa8c06edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faaa015bdc0 0x7faaa00c6120 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa01585d0 0x7faaa00ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 --2- 172.21.15.84:0/1594833615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa006faf0 0x7faaa00c01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 >> 172.21.15.84:0/1594833615 conn(0x7faaa00ccd20 msgr2=0x7faaa0072dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 shutdown_connections 2024-04-14T11:01:00.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.039+0000 7faaa5c36640 1 -- 172.21.15.84:0/1594833615 wait complete. 2024-04-14T11:01:00.044 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4308 quiesce db --set-id cc22936a --release --await' 2024-04-14T11:01:00.045 DEBUG:teuthology.orchestra.run.smithi084:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4308 quiesce db --set-id cc22936a --release --await 2024-04-14T11:01:00.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.158+0000 7ff65aa36640 1 Processor -- start 2024-04-14T11:01:00.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.158+0000 7ff65aa36640 1 -- start start 2024-04-14T11:01:00.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff65aa36640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff654151fc0 0x7ff654157d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff65aa36640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6540cc330 0x7ff6540cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff65aa36640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff654158d10 con 0x7ff65415bc90 2024-04-14T11:01:00.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff65aa36640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff65415b800 con 0x7ff654151fc0 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff65aa36640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff654158470 con 0x7ff6540cc330 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff654151fc0 0x7ff654157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff654151fc0 0x7ff654157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36132/0 (socket says 172.21.15.84:36132) 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 -- 172.21.15.84:0/3522187249 learned_addr learned my addr 172.21.15.84:0/3522187249 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff658fd3640 1 --2- 172.21.15.84:0/3522187249 >> v2:172.21.15.175:3300/0 conn(0x7ff6540cc330 0x7ff6540cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 -- 172.21.15.84:0/3522187249 >> v2:172.21.15.175:3300/0 conn(0x7ff6540cc330 msgr2=0x7ff6540cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 --2- 172.21.15.84:0/3522187249 >> v2:172.21.15.175:3300/0 conn(0x7ff6540cc330 0x7ff6540cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 -- 172.21.15.84:0/3522187249 >> v1:172.21.15.175:6789/0 conn(0x7ff65415bc90 legacy=0x7ff6540cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.159+0000 7ff653fff640 1 -- 172.21.15.84:0/3522187249 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff654158750 con 0x7ff654151fc0 2024-04-14T11:01:00.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.160+0000 7ff653fff640 1 --2- 172.21.15.84:0/3522187249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654157d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff65406ea30 tx=0x7ff64402db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f7130e1c2f7c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.160+0000 7ff652ffd640 1 -- 172.21.15.84:0/3522187249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64402f8e0 con 0x7ff654151fc0 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.160+0000 7ff652ffd640 1 -- 172.21.15.84:0/3522187249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64402fa80 con 0x7ff654151fc0 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.160+0000 7ff652ffd640 1 -- 172.21.15.84:0/3522187249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64402fe50 con 0x7ff654151fc0 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 -- 172.21.15.84:0/3522187249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 msgr2=0x7ff654157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 --2- 172.21.15.84:0/3522187249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654157d70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff65406ea30 tx=0x7ff64402db20 comp rx=0 tx=0).stop 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 -- 172.21.15.84:0/3522187249 shutdown_connections 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 --2- 172.21.15.84:0/3522187249 >> v2:172.21.15.175:3300/0 conn(0x7ff6540cc330 0x7ff6540cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 --2- 172.21.15.84:0/3522187249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654157d70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 -- 172.21.15.84:0/3522187249 >> 172.21.15.84:0/3522187249 conn(0x7ff6540c8e60 msgr2=0x7ff6540c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 -- 172.21.15.84:0/3522187249 shutdown_connections 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.161+0000 7ff65aa36640 1 -- 172.21.15.84:0/3522187249 wait complete. 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.162+0000 7ff65aa36640 1 Processor -- start 2024-04-14T11:01:00.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.162+0000 7ff65aa36640 1 -- start start 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff65aa36640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6540cc330 0x7ff654150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff65aa36640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654072e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff65aa36640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff65415bc90 0x7ff654142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff65aa36640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6540cc010 con 0x7ff654151fc0 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff65aa36640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff65415b490 con 0x7ff6540cc330 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff65aa36640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff6540ca160 con 0x7ff65415bc90 2024-04-14T11:01:00.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36136/0 (socket says 172.21.15.84:36136) 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 -- 172.21.15.84:0/2195152570 learned_addr learned my addr 172.21.15.84:0/2195152570 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff658fd3640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff65415bc90 0x7ff654142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff653fff640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6540cc330 0x7ff654150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 -- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff65415bc90 msgr2=0x7ff654142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff65415bc90 0x7ff654142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 -- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6540cc330 msgr2=0x7ff654150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6540cc330 0x7ff654150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 -- 172.21.15.84:0/2195152570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff654143900 con 0x7ff654151fc0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.163+0000 7ff6537fe640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654072e50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff64800c430 tx=0x7ff64800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.164+0000 7ff650ff9640 1 -- 172.21.15.84:0/2195152570 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6480052d0 con 0x7ff654151fc0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.164+0000 7ff650ff9640 1 -- 172.21.15.84:0/2195152570 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff648005490 con 0x7ff654151fc0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.164+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff654143ba0 con 0x7ff654151fc0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.164+0000 7ff650ff9640 1 -- 172.21.15.84:0/2195152570 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff648007260 con 0x7ff654151fc0 2024-04-14T11:01:00.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.164+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff654144160 con 0x7ff654151fc0 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.165+0000 7ff650ff9640 1 -- 172.21.15.84:0/2195152570 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff648007400 con 0x7ff654151fc0 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.166+0000 7ff650ff9640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff64006c920 0x7ff64006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.166+0000 7ff653fff640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff64006c920 0x7ff64006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.166+0000 7ff650ff9640 1 -- 172.21.15.84:0/2195152570 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7ff64808b1a0 con 0x7ff654151fc0 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.166+0000 7ff653fff640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff64006c920 0x7ff64006ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff644038000 tx=0x7ff644008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 Processor -- start 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 -- start start 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 0x55de924cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924a7a20 0x55de924a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924e5920 0x55de924ef980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de9240b340 con 0x55de924cef10 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de923b1ae0 con 0x55de924e5920 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55de92407300 con 0x55de924a7a20 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff653fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 0x55de924cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff653fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 0x55de924cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36148/0 (socket says 172.21.15.84:36148) 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.167+0000 7ff653fff640 1 -- 172.21.15.84:0/4183596285 learned_addr learned my addr 172.21.15.84:0/4183596285 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff6537fe640 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924a7a20 0x55de924a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff658fd3640 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924e5920 0x55de924ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff653fff640 1 -- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924a7a20 msgr2=0x55de924a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff653fff640 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924a7a20 0x55de924a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff653fff640 1 -- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924e5920 msgr2=0x55de924ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff653fff640 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924e5920 0x55de924ef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff653fff640 1 -- 172.21.15.84:0/4183596285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9211d920 con 0x55de924cef10 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff6537fe640 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924a7a20 0x55de924a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff653fff640 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 0x55de924cf2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff644009630 tx=0x7ff644032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc97d10933dd17e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff639ffb640 1 -- 172.21.15.84:0/4183596285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6440376e0 con 0x55de924cef10 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff639ffb640 1 -- 172.21.15.84:0/4183596285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff644037880 con 0x55de924cef10 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.168+0000 7ff639ffb640 1 -- 172.21.15.84:0/4183596285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644037c30 con 0x55de924cef10 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 -- 172.21.15.84:0/4183596285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 msgr2=0x55de924cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 0x55de924cf2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff644009630 tx=0x7ff644032000 comp rx=0 tx=0).stop 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 -- 172.21.15.84:0/4183596285 shutdown_connections 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924e5920 0x55de924ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924a7a20 0x55de924a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 --2- 172.21.15.84:0/4183596285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924cef10 0x55de924cf2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 -- 172.21.15.84:0/4183596285 >> 172.21.15.84:0/4183596285 conn(0x55de9246d3b0 msgr2=0x55de924a6520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 -- 172.21.15.84:0/4183596285 shutdown_connections 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 -- 172.21.15.84:0/4183596285 wait complete. 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 -- start start 2024-04-14T11:01:00.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.169+0000 7ff65d834740 1 Processor -- start 2024-04-14T11:01:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924e9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de924cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55de923c4ea0 con 0x55de924c9e10 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55de924cf830 con 0x55de924cef10 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55de924ca580 con 0x55de924e5920 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff65d834740 10 client.0 _ll_register_callbacks cb 0x55de923c9430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36152/0 (socket says 172.21.15.84:36152) 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 -- 172.21.15.84:0/1180494337 learned_addr learned my addr 172.21.15.84:0/1180494337 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff6537fe640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de924cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff653fff640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 -- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 msgr2=0x55de924cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de924cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 -- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 msgr2=0x55de924e9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.170+0000 7ff658fd3640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924e9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff658fd3640 1 -- 172.21.15.84:0/1180494337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de921e9d30 con 0x55de924c9e10 2024-04-14T11:01:00.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff6537fe640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de924cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff653fff640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff658fd3640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924c8220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007a00 tx=0x7ff64c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f322b22f89399bc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff632ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff632ffd640 1 -- 172.21.15.84:0/1180494337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c019020 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff632ffd640 1 -- 172.21.15.84:0/1180494337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7ff64c010bb0 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff644037880 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff632ffd640 1 -- 172.21.15.84:0/1180494337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7ff64c023050 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 10 client.5016 fetch_fsmap learned FSMap version 13 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55de924fa610 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff632ffd640 1 -- 172.21.15.84:0/1180494337 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff644037880 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff632ffd640 1 -- 172.21.15.84:0/1180494337 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7ff64c026020 con 0x55de924c9e10 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 10 client.5016 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 10 client.5016 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 20 client.5016 populate_metadata read hostname 'smithi084' 2024-04-14T11:01:00.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de924c8760 0x55de924f6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 4 client.5016 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.171+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de923aa920 con 0x55de924c8760 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.172+0000 7ff653fff640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de924c8760 0x55de924f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.172+0000 7ff653fff640 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de924c8760 0x55de924f6980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac4c42efd44ee74d server_cookie=c61cc8157eb8326b in_seq=0 out_seq=0 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.172+0000 7ff632ffd640 10 client.5016 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff632ffd640 1 -- 172.21.15.84:0/1180494337 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55de923aa920 con 0x55de924c8760 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff632ffd640 10 client.5016 handle_command_reply: tid=0 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 client.5016 shutdown 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 msgr2=0x55de924c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924c8220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007a00 tx=0x7ff64c007ec0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 shutdown_connections 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de924c8760 0x55de924f6980 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924c8220 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff632ffd640 0 client.5016 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:00.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de924cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 --2- 172.21.15.84:0/1180494337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 >> 172.21.15.84:0/1180494337 conn(0x55de9246d3b0 msgr2=0x55de924a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 shutdown_connections 2024-04-14T11:01:00.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 1 -- 172.21.15.84:0/1180494337 wait complete. 2024-04-14T11:01:00.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.173+0000 7ff65d834740 20 client.5016 trim_cache size 0 max 16384 2024-04-14T11:01:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 Processor -- start 2024-04-14T11:01:00.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 -- start start 2024-04-14T11:01:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de9249fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6541f9f30 con 0x55de924c9e10 2024-04-14T11:01:00.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff6541f9190 con 0x55de924cef10 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff6541f9860 con 0x55de924e5920 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff653fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff653fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36166/0 (socket says 172.21.15.84:36166) 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.190+0000 7ff653fff640 1 -- 172.21.15.84:0/2319863290 learned_addr learned my addr 172.21.15.84:0/2319863290 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff653fff640 1 -- 172.21.15.84:0/2319863290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 msgr2=0x55de9249fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff653fff640 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de9249fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff653fff640 1 -- 172.21.15.84:0/2319863290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 msgr2=0x55de924a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff653fff640 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff653fff640 1 -- 172.21.15.84:0/2319863290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de924e4a60 con 0x55de924c9e10 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff653fff640 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924a4a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff644009960 tx=0x7ff644041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7557a12042c9f581 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff6397fa640 1 -- 172.21.15.84:0/2319863290 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644044040 con 0x55de924c9e10 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff6397fa640 1 -- 172.21.15.84:0/2319863290 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff644004240 con 0x55de924c9e10 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff6397fa640 1 -- 172.21.15.84:0/2319863290 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644061480 con 0x55de924c9e10 2024-04-14T11:01:00.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 -- 172.21.15.84:0/2319863290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 msgr2=0x55de924a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924a4a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff644009960 tx=0x7ff644041000 comp rx=0 tx=0).stop 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 -- 172.21.15.84:0/2319863290 shutdown_connections 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924e5920 0x55de9249fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 --2- 172.21.15.84:0/2319863290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924c9e10 0x55de924a4a40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 -- 172.21.15.84:0/2319863290 >> 172.21.15.84:0/2319863290 conn(0x55de9246d3b0 msgr2=0x55de924c7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 -- 172.21.15.84:0/2319863290 shutdown_connections 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.191+0000 7ff65d834740 1 -- 172.21.15.84:0/2319863290 wait complete. 2024-04-14T11:01:00.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.192+0000 7ff65d834740 1 -- start start 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.192+0000 7ff65d834740 1 Processor -- start 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924c9e10 0x55de9249c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 0x55de924a2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff65414f9d0 con 0x55de924e5920 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff65413e040 con 0x55de924cef10 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff65413d970 con 0x55de924c9e10 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff65d834740 10 client.0 _ll_register_callbacks cb 0x7ff64c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:01:00.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 0x55de924a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 0x55de924a2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36170/0 (socket says 172.21.15.84:36170) 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 -- 172.21.15.84:0/3130677500 learned_addr learned my addr 172.21.15.84:0/3130677500 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 -- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924c9e10 msgr2=0x55de9249c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff653fff640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924c9e10 0x55de9249c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924c9e10 0x55de9249c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff6537fe640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 -- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 msgr2=0x55de924a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 -- 172.21.15.84:0/3130677500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de924c5890 con 0x55de924e5920 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff658fd3640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 0x55de924a2280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff64c010c60 tx=0x7ff64c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1280c59f3e9070c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.193+0000 7ff632ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff632ffd640 1 -- 172.21.15.84:0/3130677500 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c02b070 con 0x55de924e5920 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff632ffd640 1 -- 172.21.15.84:0/3130677500 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7ff64c015a00 con 0x55de924e5920 2024-04-14T11:01:00.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff644004240 con 0x55de924e5920 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff632ffd640 1 -- 172.21.15.84:0/3130677500 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7ff64c036050 con 0x55de924e5920 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 10 client.5022 fetch_fsmap learned FSMap version 13 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55de924fd540 con 0x55de924e5920 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff632ffd640 1 -- 172.21.15.84:0/3130677500 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff644004240 con 0x55de924e5920 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff632ffd640 1 -- 172.21.15.84:0/3130677500 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7ff64c039020 con 0x55de924e5920 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 10 client.5022 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 10 client.5022 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 20 client.5022 populate_metadata read hostname 'smithi084' 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de92568200 0x55de92564c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 4 client.5022 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cc22936a", "release": true, "await": true}] 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cc22936a", "release": true, "await": true}) -- 0x55de92418d60 con 0x55de92568200 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.194+0000 7ff653fff640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de92568200 0x55de92564c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.195+0000 7ff632ffd640 10 client.5022 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:00.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.195+0000 7ff653fff640 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de92568200 0x55de92564c30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a3542da14ae9b server_cookie=557acb358b7c7c3e in_seq=0 out_seq=0 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.467+0000 7ff632ffd640 1 -- 172.21.15.84:0/3130677500 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55de92418d60 con 0x55de92568200 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.467+0000 7ff632ffd640 10 client.5022 handle_command_reply: tid=0 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.467+0000 7ff65d834740 1 client.5022 shutdown 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 msgr2=0x55de924a2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 0x55de924a2280 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff64c010c60 tx=0x7ff64c004ab0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 shutdown_connections 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55de92568200 0x55de92564c30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55de924e5920 0x55de924a2280 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55de924cef10 0x55de924a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 --2- 172.21.15.84:0/3130677500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55de924c9e10 0x55de9249c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff632ffd640 0 client.5022 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 >> 172.21.15.84:0/3130677500 conn(0x55de9246d3b0 msgr2=0x55de924a4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 shutdown_connections 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 1 -- 172.21.15.84:0/3130677500 wait complete. 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65d834740 20 client.5022 trim_cache size 0 max 16384 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 13, 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 4308, 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 4, 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout: "cc22936a": { 2024-04-14T11:01:00.464 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 4, 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 30.0, 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 80.7, 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:00.465 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:00.466 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:00.466 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:00.466 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:00.466 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff64006c920 msgr2=0x7ff64006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff64006c920 0x7ff64006ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff644038000 tx=0x7ff644008030 comp rx=0 tx=0).stop 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 msgr2=0x7ff654072e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654072e50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff64800c430 tx=0x7ff64800c8f0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 shutdown_connections 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff64006c920 0x7ff64006ede0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff65415bc90 0x7ff654142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff654151fc0 0x7ff654072e50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 --2- 172.21.15.84:0/2195152570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6540cc330 0x7ff654150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.468+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 >> 172.21.15.84:0/2195152570 conn(0x7ff6540c8e60 msgr2=0x7ff6540c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.469+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 shutdown_connections 2024-04-14T11:01:00.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.469+0000 7ff65aa36640 1 -- 172.21.15.84:0/2195152570 wait complete. 2024-04-14T11:01:00.474 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: cc22936a, seconds elapsed: 24.2 2024-04-14T11:01:00.474 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.7 2024-04-14T11:01:00.475 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T11:01:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-04-14T11:01:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-04-14T11:01:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-04-14T11:01:00.539 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-04-14T11:01:00.540 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-04-14T11:01:00.541 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-04-14T11:01:00.542 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-04-14T11:01:00.543 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-04-14T11:01:00.544 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-04-14T11:01:00.544 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-04-14T11:01:00.544 INFO:tasks.workunit.client.0.smithi084.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-04-14T11:01:00.544 INFO:tasks.workunit.client.0.smithi084.stdout:Take third snapshot .snap/test3 2024-04-14T11:01:00.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.591+0000 7f623e836640 1 Processor -- start 2024-04-14T11:01:00.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.591+0000 7f623e836640 1 -- start start 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623e836640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6238152d60 0x7f623815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623e836640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62380c44d0 0x7f623806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623e836640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623815d000 con 0x7f62380b42d0 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623e836640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f6238071070 con 0x7f62380c44d0 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623e836640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f62380c3ad0 con 0x7f6238152d60 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623cdd3640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f62380c44d0 0x7f623806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f62377fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f62380b42d0 0x7f62380c3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:41794/0 (socket says 172.21.15.84:41794) 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f62377fe640 1 -- 172.21.15.84:0/137188010 learned_addr learned my addr 172.21.15.84:0/137188010 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623cdd3640 1 --2- 172.21.15.84:0/137188010 >> v2:172.21.15.84:3300/0 conn(0x7f62380c44d0 0x7f623806fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36172/0 (socket says 172.21.15.84:36172) 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f6237fff640 1 --2- 172.21.15.84:0/137188010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6238152d60 0x7f623815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623cdd3640 1 -- 172.21.15.84:0/137188010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6238152d60 msgr2=0x7f623815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623cdd3640 1 --2- 172.21.15.84:0/137188010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6238152d60 0x7f623815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623cdd3640 1 -- 172.21.15.84:0/137188010 >> v1:172.21.15.84:6789/0 conn(0x7f62380b42d0 legacy=0x7f62380c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f623cdd3640 1 -- 172.21.15.84:0/137188010 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62380c8e90 con 0x7f62380c44d0 2024-04-14T11:01:00.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.592+0000 7f6236ffd640 1 -- 172.21.15.84:0/137188010 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172883350 0 0) 0x7f623815d000 con 0x7f62380b42d0 2024-04-14T11:01:00.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.593+0000 7f623cdd3640 1 --2- 172.21.15.84:0/137188010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c44d0 0x7f623806fde0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6230009d90 tx=0x7f623002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e769e4dc14c6feb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.593+0000 7f6236ffd640 1 -- 172.21.15.84:0/137188010 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230039070 con 0x7f62380c44d0 2024-04-14T11:01:00.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.593+0000 7f6236ffd640 1 -- 172.21.15.84:0/137188010 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623002cc50 con 0x7f62380c44d0 2024-04-14T11:01:00.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.593+0000 7f6236ffd640 1 -- 172.21.15.84:0/137188010 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230034440 con 0x7f62380c44d0 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 -- 172.21.15.84:0/137188010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c44d0 msgr2=0x7f623806fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 --2- 172.21.15.84:0/137188010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c44d0 0x7f623806fde0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6230009d90 tx=0x7f623002bea0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 -- 172.21.15.84:0/137188010 shutdown_connections 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 --2- 172.21.15.84:0/137188010 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f62380c44d0 0x7f623806fde0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 --2- 172.21.15.84:0/137188010 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6238152d60 0x7f623815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 -- 172.21.15.84:0/137188010 >> 172.21.15.84:0/137188010 conn(0x7f6238071590 msgr2=0x7f6238071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 -- 172.21.15.84:0/137188010 shutdown_connections 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.594+0000 7f623e836640 1 -- 172.21.15.84:0/137188010 wait complete. 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.595+0000 7f623e836640 1 Processor -- start 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.595+0000 7f623e836640 1 -- start start 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623e836640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62380b42d0 0x7f6238154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623e836640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 0x7f6238151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623e836640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623814eab0 0x7f62381517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623e836640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f623806f900 con 0x7f6238152d60 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623e836640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62380c3550 con 0x7f623814eab0 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623e836640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f62380c37f0 con 0x7f62380b42d0 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 0x7f6238151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 0x7f6238151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36178/0 (socket says 172.21.15.84:36178) 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 -- 172.21.15.84:0/3595910375 learned_addr learned my addr 172.21.15.84:0/3595910375 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f623cdd3640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623814eab0 0x7f62381517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f6237fff640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62380b42d0 0x7f6238154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 -- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62380b42d0 msgr2=0x7f6238154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62380b42d0 0x7f6238154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 -- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623814eab0 msgr2=0x7f62381517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623814eab0 0x7f62381517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.596+0000 7f62377fe640 1 -- 172.21.15.84:0/3595910375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6238155d50 con 0x7f6238152d60 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.597+0000 7f62377fe640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 0x7f6238151260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f622c00c500 tx=0x7f622c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.597+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c018070 con 0x7f6238152d60 2024-04-14T11:01:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.597+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c007580 con 0x7f6238152d60 2024-04-14T11:01:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.597+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62381ef040 con 0x7f6238152d60 2024-04-14T11:01:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.597+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c004a20 con 0x7f6238152d60 2024-04-14T11:01:00.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.597+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6238153550 con 0x7f6238152d60 2024-04-14T11:01:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.598+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6238069c30 con 0x7f6238152d60 2024-04-14T11:01:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.598+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f622c01b070 con 0x7f6238152d60 2024-04-14T11:01:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.599+0000 7f6234ff9640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f622406c920 0x7f622406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.599+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f622c08ae20 con 0x7f6238152d60 2024-04-14T11:01:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.599+0000 7f6237fff640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f622406c920 0x7f622406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.599+0000 7f6237fff640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f622406c920 0x7f622406ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f62280079a0 tx=0x7f6228008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.603+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f622c058ba0 con 0x7f6238152d60 2024-04-14T11:01:00.613 INFO:tasks.workunit.client.0.smithi084.stdout:Delete the snapshots... 2024-04-14T11:01:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.829+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62380c9670 con 0x7f6238152d60 2024-04-14T11:01:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.830+0000 7f6234ff9640 1 -- 172.21.15.84:0/3595910375 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7f622c059e20 con 0x7f6238152d60 2024-04-14T11:01:00.825 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:01:00.825 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T11:01:00.825 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f622406c920 msgr2=0x7f622406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f622406c920 0x7f622406ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f62280079a0 tx=0x7f6228008040 comp rx=0 tx=0).stop 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 msgr2=0x7f6238151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 0x7f6238151260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f622c00c500 tx=0x7f622c00c9c0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 shutdown_connections 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f622406c920 0x7f622406ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f623814eab0 0x7f62381517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6238152d60 0x7f6238151260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 --2- 172.21.15.84:0/3595910375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62380b42d0 0x7f6238154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 >> 172.21.15.84:0/3595910375 conn(0x7f6238071590 msgr2=0x7f62380c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 shutdown_connections 2024-04-14T11:01:00.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.832+0000 7f623e836640 1 -- 172.21.15.84:0/3595910375 wait complete. 2024-04-14T11:01:00.839 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4308 quiesce db / --timeout 30 --expiration 80.7 --await' 2024-04-14T11:01:00.839 DEBUG:teuthology.orchestra.run.smithi084:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4308 quiesce db / --timeout 30 --expiration 80.7 --await 2024-04-14T11:01:00.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.958+0000 7f09549bb640 1 Processor -- start 2024-04-14T11:01:00.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.958+0000 7f09549bb640 1 -- start start 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f09549bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f09500ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f09549bb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09500c5290 0x7f09500cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f09549bb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f095015af40 0x7f095015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f09549bb640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f09500cd6c0 con 0x7f09500c5290 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f09549bb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f095006c880 con 0x7f095015af40 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f09549bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f095015b910 con 0x7f09500b0f10 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09500c5290 0x7f09500cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f09500c5290 0x7f09500cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36184/0 (socket says 172.21.15.84:36184) 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 -- 172.21.15.84:0/2496823419 learned_addr learned my addr 172.21.15.84:0/2496823419 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f094e59c640 1 --2- 172.21.15.84:0/2496823419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f09500ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f094ed9d640 1 --2- 172.21.15.84:0/2496823419 >> v2:172.21.15.175:3300/0 conn(0x7f095015af40 0x7f095015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 -- 172.21.15.84:0/2496823419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 msgr2=0x7f09500ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 --2- 172.21.15.84:0/2496823419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f09500ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 -- 172.21.15.84:0/2496823419 >> v2:172.21.15.175:3300/0 conn(0x7f095015af40 msgr2=0x7f095015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 --2- 172.21.15.84:0/2496823419 >> v2:172.21.15.175:3300/0 conn(0x7f095015af40 0x7f095015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f0947fff640 1 -- 172.21.15.84:0/2496823419 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09500b12f0 con 0x7f09500c5290 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.959+0000 7f094ed9d640 1 --2- 172.21.15.84:0/2496823419 >> v2:172.21.15.175:3300/0 conn(0x7f095015af40 0x7f095015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.960+0000 7f0947fff640 1 --2- 172.21.15.84:0/2496823419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500cef30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f09500cf570 tx=0x7f093802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b64368872e05d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.960+0000 7f094dd9b640 1 -- 172.21.15.84:0/2496823419 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938035020 con 0x7f09500c5290 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.960+0000 7f094dd9b640 1 -- 172.21.15.84:0/2496823419 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0938031870 con 0x7f09500c5290 2024-04-14T11:01:00.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.960+0000 7f094dd9b640 1 -- 172.21.15.84:0/2496823419 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938031c40 con 0x7f09500c5290 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 -- 172.21.15.84:0/2496823419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 msgr2=0x7f09500cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 --2- 172.21.15.84:0/2496823419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500cef30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f09500cf570 tx=0x7f093802b910 comp rx=0 tx=0).stop 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 -- 172.21.15.84:0/2496823419 shutdown_connections 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 --2- 172.21.15.84:0/2496823419 >> v2:172.21.15.175:3300/0 conn(0x7f095015af40 0x7f095015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 --2- 172.21.15.84:0/2496823419 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500cef30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 --2- 172.21.15.84:0/2496823419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f09500ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 -- 172.21.15.84:0/2496823419 >> 172.21.15.84:0/2496823419 conn(0x7f095006df00 msgr2=0x7f095006e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 -- 172.21.15.84:0/2496823419 shutdown_connections 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.961+0000 7f09549bb640 1 -- 172.21.15.84:0/2496823419 wait complete. 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.962+0000 7f09549bb640 1 Processor -- start 2024-04-14T11:01:00.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.962+0000 7f09549bb640 1 -- start start 2024-04-14T11:01:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f09549bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f0950156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f09549bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f09549bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095015af40 0x7f09500af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f09549bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f09500c9830 con 0x7f09500c5290 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f09549bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09500cdbd0 con 0x7f095015af40 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f09549bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f09500c9b10 con 0x7f09500b0f10 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36190/0 (socket says 172.21.15.84:36190) 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 -- 172.21.15.84:0/2003080130 learned_addr learned my addr 172.21.15.84:0/2003080130 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f094e59c640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f0950156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f094ed9d640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095015af40 0x7f09500af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 -- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 msgr2=0x7f0950156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f0950156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 -- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095015af40 msgr2=0x7f09500af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095015af40 0x7f09500af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 -- 172.21.15.84:0/2003080130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09501f0940 con 0x7f09500c5290 2024-04-14T11:01:00.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.963+0000 7f0947fff640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500b1830 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f093802b950 tx=0x7f09380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.964+0000 7f0946ffd640 1 -- 172.21.15.84:0/2003080130 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093803ad60 con 0x7f09500c5290 2024-04-14T11:01:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.964+0000 7f0946ffd640 1 -- 172.21.15.84:0/2003080130 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09380443f0 con 0x7f09500c5290 2024-04-14T11:01:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.964+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09501f0be0 con 0x7f09500c5290 2024-04-14T11:01:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.964+0000 7f0946ffd640 1 -- 172.21.15.84:0/2003080130 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09380447c0 con 0x7f09500c5290 2024-04-14T11:01:00.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.964+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09501f11a0 con 0x7f09500c5290 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.965+0000 7f0946ffd640 1 -- 172.21.15.84:0/2003080130 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0938038020 con 0x7f09500c5290 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.966+0000 7f0946ffd640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f093006c920 0x7f093006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.966+0000 7f094e59c640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f093006c920 0x7f093006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.966+0000 7f0946ffd640 1 -- 172.21.15.84:0/2003080130 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f09380ade40 con 0x7f09500c5290 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.966+0000 7f094e59c640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f093006c920 0x7f093006ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0940006fd0 tx=0x7f0940008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.967+0000 7f09577aa740 1 Processor -- start 2024-04-14T11:01:00.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.967+0000 7f09577aa740 1 -- start start 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f09577aa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a396a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a396f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a395090 0x55ea4a3d5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f09577aa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ea4a2fb040 con 0x55ea4a396630 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea4a2a1a70 con 0x55ea4a395090 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ea4a2f7000 con 0x55ea4a3e04b0 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a396a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f0947fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a396f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a396a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36206/0 (socket says 172.21.15.84:36206) 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 -- 172.21.15.84:0/1160224580 learned_addr learned my addr 172.21.15.84:0/1160224580 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f0947fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a396f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:45538/0 (socket says 172.21.15.84:45538) 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094ed9d640 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a395090 0x55ea4a3d5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 -- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 msgr2=0x55ea4a396f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a396f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 -- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a395090 msgr2=0x55ea4a3d5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a395090 0x55ea4a3d5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 -- 172.21.15.84:0/1160224580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4a0d9c90 con 0x55ea4a396630 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f0947fff640 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a396f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094ed9d640 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a395090 0x55ea4a3d5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f094e59c640 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a396a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f094000b940 tx=0x7f0940004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3532643e2a6037 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f092ffff640 1 -- 172.21.15.84:0/1160224580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094001c050 con 0x55ea4a396630 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f092ffff640 1 -- 172.21.15.84:0/1160224580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940026070 con 0x55ea4a396630 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.968+0000 7f092ffff640 1 -- 172.21.15.84:0/1160224580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940016e10 con 0x55ea4a396630 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 -- 172.21.15.84:0/1160224580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 msgr2=0x55ea4a396a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a396a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f094000b940 tx=0x7f0940004610 comp rx=0 tx=0).stop 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 -- 172.21.15.84:0/1160224580 shutdown_connections 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a395090 0x55ea4a3d5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a396f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 --2- 172.21.15.84:0/1160224580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a396a10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 -- 172.21.15.84:0/1160224580 >> 172.21.15.84:0/1160224580 conn(0x55ea4a392da0 msgr2=0x55ea4a3956e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 -- 172.21.15.84:0/1160224580 shutdown_connections 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.969+0000 7f09577aa740 1 -- 172.21.15.84:0/1160224580 wait complete. 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.970+0000 7f09577aa740 1 -- start start 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.970+0000 7f09577aa740 1 Processor -- start 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a3e9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3dc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ea4a3bbb90 con 0x55ea4a3e04b0 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ea4a2b4e30 con 0x55ea4a396630 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ea4a393f50 con 0x55ea4a3db6e0 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f09577aa740 10 client.0 _ll_register_callbacks cb 0x55ea4a281810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f0947fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a3e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094ed9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3dc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a3e9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:50692/0 (socket says 172.21.15.84:50692) 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 -- 172.21.15.84:0/2792286769 learned_addr learned my addr 172.21.15.84:0/2792286769 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f0947fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3dbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36216/0 (socket says 172.21.15.84:36216) 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 -- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 msgr2=0x55ea4a3dc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3dc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 -- 172.21.15.84:0/2792286769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3e04b0 msgr2=0x55ea4a3dbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3dbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.971+0000 7f094e59c640 1 -- 172.21.15.84:0/2792286769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4a13a420 con 0x55ea4a396630 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f094e59c640 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a3e9750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0940023040 tx=0x7f0940004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efacafbca5dc09f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f092d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f092d7fa640 1 -- 172.21.15.84:0/2792286769 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940021a00 con 0x55ea4a396630 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f092d7fa640 1 -- 172.21.15.84:0/2792286769 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f0940021ba0 con 0x55ea4a396630 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0940026070 con 0x55ea4a396630 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f092d7fa640 1 -- 172.21.15.84:0/2792286769 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f094001c020 con 0x55ea4a396630 2024-04-14T11:01:00.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 10 client.4834 fetch_fsmap learned FSMap version 13 2024-04-14T11:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55ea49fcd580 con 0x55ea4a396630 2024-04-14T11:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f092d7fa640 1 -- 172.21.15.84:0/2792286769 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940026070 con 0x55ea4a396630 2024-04-14T11:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f092d7fa640 1 -- 172.21.15.84:0/2792286769 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f0940014430 con 0x55ea4a396630 2024-04-14T11:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 10 client.4834 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 10 client.4834 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:01:00.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 20 client.4834 populate_metadata read hostname 'smithi084' 2024-04-14T11:01:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a3bf370 0x55ea4a3bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 4 client.4834 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T11:01:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.972+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea4a308a60 con 0x55ea4a3bf370 2024-04-14T11:01:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.973+0000 7f0947fff640 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a3bf370 0x55ea4a3bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.973+0000 7f092d7fa640 10 client.4834 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:00.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.973+0000 7f0947fff640 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a3bf370 0x55ea4a3bf7c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b181a6d4a7dbba31 server_cookie=cae2cd6bb4b0c42c in_seq=0 out_seq=0 2024-04-14T11:01:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.974+0000 7f092d7fa640 1 -- 172.21.15.84:0/2792286769 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ea4a308a60 con 0x55ea4a3bf370 2024-04-14T11:01:00.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.974+0000 7f092d7fa640 10 client.4834 handle_command_reply: tid=0 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.974+0000 7f09577aa740 1 client.4834 shutdown 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 msgr2=0x55ea4a3e9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a3e9750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0940023040 tx=0x7f0940004730 comp rx=0 tx=0).stop 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 shutdown_connections 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a3bf370 0x55ea4a3bf7c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3dc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f092d7fa640 0 client.4834 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 --2- 172.21.15.84:0/2792286769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a3e9750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 >> 172.21.15.84:0/2792286769 conn(0x55ea4a395090 msgr2=0x55ea4a38fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 shutdown_connections 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 1 -- 172.21.15.84:0/2792286769 wait complete. 2024-04-14T11:01:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.975+0000 7f09577aa740 20 client.4834 trim_cache size 0 max 16384 2024-04-14T11:01:00.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 Processor -- start 2024-04-14T11:01:00.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 -- start start 2024-04-14T11:01:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a3d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3d6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3d4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ea4a3e8d30 con 0x55ea4a396630 2024-04-14T11:01:00.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09501fe360 con 0x55ea4a3e04b0 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.997+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f09501fd5c0 con 0x55ea4a3db6e0 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a3d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a3d5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36222/0 (socket says 172.21.15.84:36222) 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 -- 172.21.15.84:0/3139483798 learned_addr learned my addr 172.21.15.84:0/3139483798 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094ed9d640 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f0947fff640 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3d6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 -- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 msgr2=0x55ea4a3d6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3d6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 -- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a3e04b0 msgr2=0x55ea4a3d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3d4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 -- 172.21.15.84:0/3139483798 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4a3bbd70 con 0x55ea4a396630 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f094e59c640 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a3d5d50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f094000b200 tx=0x7f094002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579b1fc0b4185140 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f092f7fe640 1 -- 172.21.15.84:0/3139483798 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940046070 con 0x55ea4a396630 2024-04-14T11:01:00.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f092f7fe640 1 -- 172.21.15.84:0/3139483798 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940026070 con 0x55ea4a396630 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.998+0000 7f092f7fe640 1 -- 172.21.15.84:0/3139483798 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940004260 con 0x55ea4a396630 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 -- 172.21.15.84:0/3139483798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 msgr2=0x55ea4a3d5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a3d5d50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f094000b200 tx=0x7f094002c000 comp rx=0 tx=0).stop 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 -- 172.21.15.84:0/3139483798 shutdown_connections 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a3e04b0 0x55ea4a3d4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3db6e0 0x55ea4a3d6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 --2- 172.21.15.84:0/3139483798 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a396630 0x55ea4a3d5d50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 -- 172.21.15.84:0/3139483798 >> 172.21.15.84:0/3139483798 conn(0x55ea4a395090 msgr2=0x55ea4a397d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 -- 172.21.15.84:0/3139483798 shutdown_connections 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:00.999+0000 7f09577aa740 1 -- 172.21.15.84:0/3139483798 wait complete. 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.000+0000 7f09577aa740 1 -- start start 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.000+0000 7f09577aa740 1 Processor -- start 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a44af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 0x55ea4a3dbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a3dc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:01.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f09501fc480 con 0x55ea4a3db6e0 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f09501fdc90 con 0x55ea4a396630 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f095014dc30 con 0x55ea4a3e04b0 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 10 client.0 _ll_register_callbacks cb 0x7f0948009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f0947fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 0x55ea4a3dbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a44af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f0947fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 0x55ea4a3dbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36228/0 (socket says 172.21.15.84:36228) 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f0947fff640 1 -- 172.21.15.84:0/863756727 learned_addr learned my addr 172.21.15.84:0/863756727 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094ed9d640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a3dc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 -- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 msgr2=0x55ea4a3dc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a3dc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 -- 172.21.15.84:0/863756727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 msgr2=0x55ea4a3dbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 0x55ea4a3dbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 -- 172.21.15.84:0/863756727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4a3bab30 con 0x55ea4a396630 2024-04-14T11:01:01.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f0947fff640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 0x55ea4a3dbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f094e59c640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a44af20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0940043000 tx=0x7f094001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=effd7e4616e81a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f092d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f092d7fa640 1 -- 172.21.15.84:0/863756727 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940046020 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f092d7fa640 1 -- 172.21.15.84:0/863756727 <== mon.1 v2:172.21.15.175:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 5940+0+0 (secure 0 0 0) 0x7f0940021c00 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.001+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0940026070 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f092d7fa640 1 -- 172.21.15.84:0/863756727 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f0940050050 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 10 client.4840 fetch_fsmap learned FSMap version 13 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55ea4a3d6c30 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f092d7fa640 1 -- 172.21.15.84:0/863756727 <== mon.1 v2:172.21.15.175:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940026070 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f092d7fa640 1 -- 172.21.15.84:0/863756727 <== mon.1 v2:172.21.15.175:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7f0940053020 con 0x55ea4a396630 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 10 client.4840 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 10 client.4840 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 20 client.4840 populate_metadata read hostname 'smithi084' 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a450b30 0x55ea4a454010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:01.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 4 client.4840 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.7, "await": true}] 2024-04-14T11:01:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 80.7, "await": true}) -- 0x55ea4a3028d0 con 0x55ea4a450b30 2024-04-14T11:01:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f0947fff640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a450b30 0x55ea4a454010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f0947fff640 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a450b30 0x55ea4a454010 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95a643ec56d40ce9 server_cookie=10076ac06dc9466 in_seq=0 out_seq=0 2024-04-14T11:01:01.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.002+0000 7f092d7fa640 10 client.4840 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:01.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f092d7fa640 1 -- 172.21.15.84:0/863756727 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55ea4a3028d0 con 0x55ea4a450b30 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f092d7fa640 10 client.4840 handle_command_reply: tid=0 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 client.4840 shutdown 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 msgr2=0x55ea4a44af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a44af20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0940043000 tx=0x7f094001f000 comp rx=0 tx=0).stop 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 shutdown_connections 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ea4a450b30 0x55ea4a454010 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ea4a3e04b0 0x55ea4a3dc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ea4a3db6e0 0x55ea4a3dbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 --2- 172.21.15.84:0/863756727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ea4a396630 0x55ea4a44af20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f092d7fa640 0 client.4840 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:01.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 >> 172.21.15.84:0/863756727 conn(0x55ea4a395090 msgr2=0x55ea4a38fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:01.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 shutdown_connections 2024-04-14T11:01:01.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.746+0000 7f09577aa740 1 -- 172.21.15.84:0/863756727 wait complete. 2024-04-14T11:01:01.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09577aa740 20 client.4840 trim_cache size 0 max 16384 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 13, 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 4308, 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 6, 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "997e9b42": { 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 6, 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:01:01.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 30.0, 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 80.7, 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCED", 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:01.746 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T11:01:01.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f093006c920 msgr2=0x7f093006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:01.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f093006c920 0x7f093006ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0940006fd0 tx=0x7f0940008040 comp rx=0 tx=0).stop 2024-04-14T11:01:01.747 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 msgr2=0x7f09500b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500b1830 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f093802b950 tx=0x7f09380046c0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 shutdown_connections 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f093006c920 0x7f093006ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095015af40 0x7f09500af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f09500c5290 0x7f09500b1830 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 --2- 172.21.15.84:0/2003080130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09500b0f10 0x7f0950156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 >> 172.21.15.84:0/2003080130 conn(0x7f095006df00 msgr2=0x7f095006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 shutdown_connections 2024-04-14T11:01:01.748 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:01.747+0000 7f09549bb640 1 -- 172.21.15.84:0/2003080130 wait complete. 2024-04-14T11:01:01.755 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 997e9b42, quiesce duration: 20.7 2024-04-14T11:01:02.241 INFO:tasks.workunit.client.0.smithi084.stdout:.//.snap/test1 2024-04-14T11:01:02.242 INFO:tasks.workunit.client.0.smithi084.stdout:.//.snap/test2 2024-04-14T11:01:02.242 INFO:tasks.workunit.client.0.smithi084.stdout:.//.snap/test3 2024-04-14T11:01:02.249 INFO:tasks.workunit.client.0.smithi084.stdout:./274/.snap/snap-subdir-test 2024-04-14T11:01:02.258 INFO:tasks.workunit.client.0.smithi084.stdout:./166/.snap/snap-subdir-test 2024-04-14T11:01:02.267 INFO:tasks.workunit.client.0.smithi084.stdout:./256/.snap/snap-subdir-test 2024-04-14T11:01:02.274 INFO:tasks.workunit.client.0.smithi084.stdout:./247/.snap/snap-subdir-test 2024-04-14T11:01:02.282 INFO:tasks.workunit.client.0.smithi084.stdout:./248/.snap/snap-subdir-test 2024-04-14T11:01:02.291 INFO:tasks.workunit.client.0.smithi084.stdout:./147/.snap/snap-subdir-test 2024-04-14T11:01:02.300 INFO:tasks.workunit.client.0.smithi084.stdout:./151/.snap/snap-subdir-test 2024-04-14T11:01:02.308 INFO:tasks.workunit.client.0.smithi084.stdout:./170/.snap/snap-subdir-test 2024-04-14T11:01:02.317 INFO:tasks.workunit.client.0.smithi084.stdout:./167/.snap/snap-subdir-test 2024-04-14T11:01:02.326 INFO:tasks.workunit.client.0.smithi084.stdout:./140/.snap/snap-subdir-test 2024-04-14T11:01:02.333 INFO:tasks.workunit.client.0.smithi084.stdout:./142/.snap/snap-subdir-test 2024-04-14T11:01:02.342 INFO:tasks.workunit.client.0.smithi084.stdout:./150/.snap/snap-subdir-test 2024-04-14T11:01:02.350 INFO:tasks.workunit.client.0.smithi084.stdout:./273/.snap/snap-subdir-test 2024-04-14T11:01:02.358 INFO:tasks.workunit.client.0.smithi084.stdout:./269/.snap/snap-subdir-test 2024-04-14T11:01:02.367 INFO:tasks.workunit.client.0.smithi084.stdout:./105/.snap/snap-subdir-test 2024-04-14T11:01:02.374 INFO:tasks.workunit.client.0.smithi084.stdout:./210/.snap/snap-subdir-test 2024-04-14T11:01:02.382 INFO:tasks.workunit.client.0.smithi084.stdout:./265/.snap/snap-subdir-test 2024-04-14T11:01:02.390 INFO:tasks.workunit.client.0.smithi084.stdout:./218/.snap/snap-subdir-test 2024-04-14T11:01:02.398 INFO:tasks.workunit.client.0.smithi084.stdout:./290/.snap/snap-subdir-test 2024-04-14T11:01:02.407 INFO:tasks.workunit.client.0.smithi084.stdout:./149/.snap/snap-subdir-test 2024-04-14T11:01:02.415 INFO:tasks.workunit.client.0.smithi084.stdout:./109/.snap/snap-subdir-test 2024-04-14T11:01:02.424 INFO:tasks.workunit.client.0.smithi084.stdout:./292/.snap/snap-subdir-test 2024-04-14T11:01:02.432 INFO:tasks.workunit.client.0.smithi084.stdout:./242/.snap/snap-subdir-test 2024-04-14T11:01:02.440 INFO:tasks.workunit.client.0.smithi084.stdout:./158/.snap/snap-subdir-test 2024-04-14T11:01:02.449 INFO:tasks.workunit.client.0.smithi084.stdout:./243/.snap/snap-subdir-test 2024-04-14T11:01:02.457 INFO:tasks.workunit.client.0.smithi084.stdout:./106/.snap/snap-subdir-test 2024-04-14T11:01:02.466 INFO:tasks.workunit.client.0.smithi084.stdout:./250/.snap/snap-subdir-test 2024-04-14T11:01:02.473 INFO:tasks.workunit.client.0.smithi084.stdout:./221/.snap/snap-subdir-test 2024-04-14T11:01:02.481 INFO:tasks.workunit.client.0.smithi084.stdout:./244/.snap/snap-subdir-test 2024-04-14T11:01:02.489 INFO:tasks.workunit.client.0.smithi084.stdout:./258/.snap/snap-subdir-test 2024-04-14T11:01:02.497 INFO:tasks.workunit.client.0.smithi084.stdout:./268/.snap/snap-subdir-test 2024-04-14T11:01:02.507 INFO:tasks.workunit.client.0.smithi084.stdout:./189/.snap/snap-subdir-test 2024-04-14T11:01:02.514 INFO:tasks.workunit.client.0.smithi084.stdout:./285/.snap/snap-subdir-test 2024-04-14T11:01:02.522 INFO:tasks.workunit.client.0.smithi084.stdout:./208/.snap/snap-subdir-test 2024-04-14T11:01:02.530 INFO:tasks.workunit.client.0.smithi084.stdout:./288/.snap/snap-subdir-test 2024-04-14T11:01:02.538 INFO:tasks.workunit.client.0.smithi084.stdout:./209/.snap/snap-subdir-test 2024-04-14T11:01:02.546 INFO:tasks.workunit.client.0.smithi084.stdout:./253/.snap/snap-subdir-test 2024-04-14T11:01:02.554 INFO:tasks.workunit.client.0.smithi084.stdout:./249/.snap/snap-subdir-test 2024-04-14T11:01:02.562 INFO:tasks.workunit.client.0.smithi084.stdout:./133/.snap/snap-subdir-test 2024-04-14T11:01:02.569 INFO:tasks.workunit.client.0.smithi084.stdout:./291/.snap/snap-subdir-test 2024-04-14T11:01:02.577 INFO:tasks.workunit.client.0.smithi084.stdout:./226/.snap/snap-subdir-test 2024-04-14T11:01:02.586 INFO:tasks.workunit.client.0.smithi084.stdout:./173/.snap/snap-subdir-test 2024-04-14T11:01:02.594 INFO:tasks.workunit.client.0.smithi084.stdout:./174/.snap/snap-subdir-test 2024-04-14T11:01:02.602 INFO:tasks.workunit.client.0.smithi084.stdout:./299/.snap/snap-subdir-test 2024-04-14T11:01:02.610 INFO:tasks.workunit.client.0.smithi084.stdout:./262/.snap/snap-subdir-test 2024-04-14T11:01:02.618 INFO:tasks.workunit.client.0.smithi084.stdout:./231/.snap/snap-subdir-test 2024-04-14T11:01:02.627 INFO:tasks.workunit.client.0.smithi084.stdout:./214/.snap/snap-subdir-test 2024-04-14T11:01:02.634 INFO:tasks.workunit.client.0.smithi084.stdout:./281/.snap/snap-subdir-test 2024-04-14T11:01:02.643 INFO:tasks.workunit.client.0.smithi084.stdout:./289/.snap/snap-subdir-test 2024-04-14T11:01:02.652 INFO:tasks.workunit.client.0.smithi084.stdout:./283/.snap/snap-subdir-test 2024-04-14T11:01:02.660 INFO:tasks.workunit.client.0.smithi084.stdout:./232/.snap/snap-subdir-test 2024-04-14T11:01:02.669 INFO:tasks.workunit.client.0.smithi084.stdout:./298/.snap/snap-subdir-test 2024-04-14T11:01:02.677 INFO:tasks.workunit.client.0.smithi084.stdout:./233/.snap/snap-subdir-test 2024-04-14T11:01:02.685 INFO:tasks.workunit.client.0.smithi084.stdout:./155/.snap/snap-subdir-test 2024-04-14T11:01:02.695 INFO:tasks.workunit.client.0.smithi084.stdout:./114/.snap/snap-subdir-test 2024-04-14T11:01:02.704 INFO:tasks.workunit.client.0.smithi084.stdout:./159/.snap/snap-subdir-test 2024-04-14T11:01:02.713 INFO:tasks.workunit.client.0.smithi084.stdout:./187/.snap/snap-subdir-test 2024-04-14T11:01:02.722 INFO:tasks.workunit.client.0.smithi084.stdout:./185/.snap/snap-subdir-test 2024-04-14T11:01:02.730 INFO:tasks.workunit.client.0.smithi084.stdout:./293/.snap/snap-subdir-test 2024-04-14T11:01:02.738 INFO:tasks.workunit.client.0.smithi084.stdout:./228/.snap/snap-subdir-test 2024-04-14T11:01:02.747 INFO:tasks.workunit.client.0.smithi084.stdout:./120/.snap/snap-subdir-test 2024-04-14T11:01:02.756 INFO:tasks.workunit.client.0.smithi084.stdout:./110/.snap/snap-subdir-test 2024-04-14T11:01:02.765 INFO:tasks.workunit.client.0.smithi084.stdout:./267/.snap/snap-subdir-test 2024-04-14T11:01:02.773 INFO:tasks.workunit.client.0.smithi084.stdout:./202/.snap/snap-subdir-test 2024-04-14T11:01:02.782 INFO:tasks.workunit.client.0.smithi084.stdout:./137/.snap/snap-subdir-test 2024-04-14T11:01:02.791 INFO:tasks.workunit.client.0.smithi084.stdout:./246/.snap/snap-subdir-test 2024-04-14T11:01:02.801 INFO:tasks.workunit.client.0.smithi084.stdout:./219/.snap/snap-subdir-test 2024-04-14T11:01:02.811 INFO:tasks.workunit.client.0.smithi084.stdout:./198/.snap/snap-subdir-test 2024-04-14T11:01:02.820 INFO:tasks.workunit.client.0.smithi084.stdout:./136/.snap/snap-subdir-test 2024-04-14T11:01:02.830 INFO:tasks.workunit.client.0.smithi084.stdout:./270/.snap/snap-subdir-test 2024-04-14T11:01:02.837 INFO:tasks.workunit.client.0.smithi084.stdout:./125/.snap/snap-subdir-test 2024-04-14T11:01:02.845 INFO:tasks.workunit.client.0.smithi084.stdout:./194/.snap/snap-subdir-test 2024-04-14T11:01:02.855 INFO:tasks.workunit.client.0.smithi084.stdout:./119/.snap/snap-subdir-test 2024-04-14T11:01:02.863 INFO:tasks.workunit.client.0.smithi084.stdout:./297/.snap/snap-subdir-test 2024-04-14T11:01:02.871 INFO:tasks.workunit.client.0.smithi084.stdout:./230/.snap/snap-subdir-test 2024-04-14T11:01:02.879 INFO:tasks.workunit.client.0.smithi084.stdout:./260/.snap/snap-subdir-test 2024-04-14T11:01:02.888 INFO:tasks.workunit.client.0.smithi084.stdout:./157/.snap/snap-subdir-test 2024-04-14T11:01:02.897 INFO:tasks.workunit.client.0.smithi084.stdout:./172/.snap/snap-subdir-test 2024-04-14T11:01:02.905 INFO:tasks.workunit.client.0.smithi084.stdout:./277/.snap/snap-subdir-test 2024-04-14T11:01:02.913 INFO:tasks.workunit.client.0.smithi084.stdout:./186/.snap/snap-subdir-test 2024-04-14T11:01:02.921 INFO:tasks.workunit.client.0.smithi084.stdout:./237/.snap/snap-subdir-test 2024-04-14T11:01:02.931 INFO:tasks.workunit.client.0.smithi084.stdout:./190/.snap/snap-subdir-test 2024-04-14T11:01:02.939 INFO:tasks.workunit.client.0.smithi084.stdout:./213/.snap/snap-subdir-test 2024-04-14T11:01:02.948 INFO:tasks.workunit.client.0.smithi084.stdout:./104/.snap/snap-subdir-test 2024-04-14T11:01:02.957 INFO:tasks.workunit.client.0.smithi084.stdout:./164/.snap/snap-subdir-test 2024-04-14T11:01:02.966 INFO:tasks.workunit.client.0.smithi084.stdout:./112/.snap/snap-subdir-test 2024-04-14T11:01:02.985 INFO:tasks.workunit.client.0.smithi084.stdout:./295/.snap/snap-subdir-test 2024-04-14T11:01:02.994 INFO:tasks.workunit.client.0.smithi084.stdout:./272/.snap/snap-subdir-test 2024-04-14T11:01:03.003 INFO:tasks.workunit.client.0.smithi084.stdout:./100/.snap/snap-subdir-test 2024-04-14T11:01:03.011 INFO:tasks.workunit.client.0.smithi084.stdout:./134/.snap/snap-subdir-test 2024-04-14T11:01:03.019 INFO:tasks.workunit.client.0.smithi084.stdout:./200/.snap/snap-subdir-test 2024-04-14T11:01:03.028 INFO:tasks.workunit.client.0.smithi084.stdout:./115/.snap/snap-subdir-test 2024-04-14T11:01:03.037 INFO:tasks.workunit.client.0.smithi084.stdout:./284/.snap/snap-subdir-test 2024-04-14T11:01:03.044 INFO:tasks.workunit.client.0.smithi084.stdout:./280/.snap/snap-subdir-test 2024-04-14T11:01:03.053 INFO:tasks.workunit.client.0.smithi084.stdout:./116/.snap/snap-subdir-test 2024-04-14T11:01:03.061 INFO:tasks.workunit.client.0.smithi084.stdout:./245/.snap/snap-subdir-test 2024-04-14T11:01:03.069 INFO:tasks.workunit.client.0.smithi084.stdout:./195/.snap/snap-subdir-test 2024-04-14T11:01:03.078 INFO:tasks.workunit.client.0.smithi084.stdout:./138/.snap/snap-subdir-test 2024-04-14T11:01:03.087 INFO:tasks.workunit.client.0.smithi084.stdout:./135/.snap/snap-subdir-test 2024-04-14T11:01:03.095 INFO:tasks.workunit.client.0.smithi084.stdout:./117/.snap/snap-subdir-test 2024-04-14T11:01:03.102 INFO:tasks.workunit.client.0.smithi084.stdout:./241/.snap/snap-subdir-test 2024-04-14T11:01:03.111 INFO:tasks.workunit.client.0.smithi084.stdout:./143/.snap/snap-subdir-test 2024-04-14T11:01:03.120 INFO:tasks.workunit.client.0.smithi084.stdout:./180/.snap/snap-subdir-test 2024-04-14T11:01:03.128 INFO:tasks.workunit.client.0.smithi084.stdout:./126/.snap/snap-subdir-test 2024-04-14T11:01:03.137 INFO:tasks.workunit.client.0.smithi084.stdout:./161/.snap/snap-subdir-test 2024-04-14T11:01:03.145 INFO:tasks.workunit.client.0.smithi084.stdout:./204/.snap/snap-subdir-test 2024-04-14T11:01:03.153 INFO:tasks.workunit.client.0.smithi084.stdout:./176/.snap/snap-subdir-test 2024-04-14T11:01:03.161 INFO:tasks.workunit.client.0.smithi084.stdout:./255/.snap/snap-subdir-test 2024-04-14T11:01:03.169 INFO:tasks.workunit.client.0.smithi084.stdout:./215/.snap/snap-subdir-test 2024-04-14T11:01:03.178 INFO:tasks.workunit.client.0.smithi084.stdout:./111/.snap/snap-subdir-test 2024-04-14T11:01:03.186 INFO:tasks.workunit.client.0.smithi084.stdout:./238/.snap/snap-subdir-test 2024-04-14T11:01:03.195 INFO:tasks.workunit.client.0.smithi084.stdout:./191/.snap/snap-subdir-test 2024-04-14T11:01:03.204 INFO:tasks.workunit.client.0.smithi084.stdout:./184/.snap/snap-subdir-test 2024-04-14T11:01:03.213 INFO:tasks.workunit.client.0.smithi084.stdout:./192/.snap/snap-subdir-test 2024-04-14T11:01:03.221 INFO:tasks.workunit.client.0.smithi084.stdout:./103/.snap/snap-subdir-test 2024-04-14T11:01:03.230 INFO:tasks.workunit.client.0.smithi084.stdout:./128/.snap/snap-subdir-test 2024-04-14T11:01:03.238 INFO:tasks.workunit.client.0.smithi084.stdout:./229/.snap/snap-subdir-test 2024-04-14T11:01:03.246 INFO:tasks.workunit.client.0.smithi084.stdout:./144/.snap/snap-subdir-test 2024-04-14T11:01:03.255 INFO:tasks.workunit.client.0.smithi084.stdout:./146/.snap/snap-subdir-test 2024-04-14T11:01:03.263 INFO:tasks.workunit.client.0.smithi084.stdout:./227/.snap/snap-subdir-test 2024-04-14T11:01:03.270 INFO:tasks.workunit.client.0.smithi084.stdout:./278/.snap/snap-subdir-test 2024-04-14T11:01:03.279 INFO:tasks.workunit.client.0.smithi084.stdout:./141/.snap/snap-subdir-test 2024-04-14T11:01:03.286 INFO:tasks.workunit.client.0.smithi084.stdout:./234/.snap/snap-subdir-test 2024-04-14T11:01:03.294 INFO:tasks.workunit.client.0.smithi084.stdout:./225/.snap/snap-subdir-test 2024-04-14T11:01:03.303 INFO:tasks.workunit.client.0.smithi084.stdout:./182/.snap/snap-subdir-test 2024-04-14T11:01:03.311 INFO:tasks.workunit.client.0.smithi084.stdout:./107/.snap/snap-subdir-test 2024-04-14T11:01:03.320 INFO:tasks.workunit.client.0.smithi084.stdout:./178/.snap/snap-subdir-test 2024-04-14T11:01:03.327 INFO:tasks.workunit.client.0.smithi084.stdout:./266/.snap/snap-subdir-test 2024-04-14T11:01:03.337 INFO:tasks.workunit.client.0.smithi084.stdout:./240/.snap/snap-subdir-test 2024-04-14T11:01:03.344 INFO:tasks.workunit.client.0.smithi084.stdout:./156/.snap/snap-subdir-test 2024-04-14T11:01:03.353 INFO:tasks.workunit.client.0.smithi084.stdout:./131/.snap/snap-subdir-test 2024-04-14T11:01:03.361 INFO:tasks.workunit.client.0.smithi084.stdout:./123/.snap/snap-subdir-test 2024-04-14T11:01:03.369 INFO:tasks.workunit.client.0.smithi084.stdout:./160/.snap/snap-subdir-test 2024-04-14T11:01:03.378 INFO:tasks.workunit.client.0.smithi084.stdout:./165/.snap/snap-subdir-test 2024-04-14T11:01:03.385 INFO:tasks.workunit.client.0.smithi084.stdout:./101/.snap/snap-subdir-test 2024-04-14T11:01:03.394 INFO:tasks.workunit.client.0.smithi084.stdout:./148/.snap/snap-subdir-test 2024-04-14T11:01:03.402 INFO:tasks.workunit.client.0.smithi084.stdout:./168/.snap/snap-subdir-test 2024-04-14T11:01:03.411 INFO:tasks.workunit.client.0.smithi084.stdout:./179/.snap/snap-subdir-test 2024-04-14T11:01:03.418 INFO:tasks.workunit.client.0.smithi084.stdout:./257/.snap/snap-subdir-test 2024-04-14T11:01:03.426 INFO:tasks.workunit.client.0.smithi084.stdout:./252/.snap/snap-subdir-test 2024-04-14T11:01:03.434 INFO:tasks.workunit.client.0.smithi084.stdout:./132/.snap/snap-subdir-test 2024-04-14T11:01:03.442 INFO:tasks.workunit.client.0.smithi084.stdout:./236/.snap/snap-subdir-test 2024-04-14T11:01:03.450 INFO:tasks.workunit.client.0.smithi084.stdout:./211/.snap/snap-subdir-test 2024-04-14T11:01:03.458 INFO:tasks.workunit.client.0.smithi084.stdout:./199/.snap/snap-subdir-test 2024-04-14T11:01:03.466 INFO:tasks.workunit.client.0.smithi084.stdout:./205/.snap/snap-subdir-test 2024-04-14T11:01:03.475 INFO:tasks.workunit.client.0.smithi084.stdout:./163/.snap/snap-subdir-test 2024-04-14T11:01:03.483 INFO:tasks.workunit.client.0.smithi084.stdout:./261/.snap/snap-subdir-test 2024-04-14T11:01:03.491 INFO:tasks.workunit.client.0.smithi084.stdout:./201/.snap/snap-subdir-test 2024-04-14T11:01:03.499 INFO:tasks.workunit.client.0.smithi084.stdout:./282/.snap/snap-subdir-test 2024-04-14T11:01:03.507 INFO:tasks.workunit.client.0.smithi084.stdout:./296/.snap/snap-subdir-test 2024-04-14T11:01:03.515 INFO:tasks.workunit.client.0.smithi084.stdout:./217/.snap/snap-subdir-test 2024-04-14T11:01:03.523 INFO:tasks.workunit.client.0.smithi084.stdout:./153/.snap/snap-subdir-test 2024-04-14T11:01:03.531 INFO:tasks.workunit.client.0.smithi084.stdout:./206/.snap/snap-subdir-test 2024-04-14T11:01:03.539 INFO:tasks.workunit.client.0.smithi084.stdout:./122/.snap/snap-subdir-test 2024-04-14T11:01:03.548 INFO:tasks.workunit.client.0.smithi084.stdout:./162/.snap/snap-subdir-test 2024-04-14T11:01:03.556 INFO:tasks.workunit.client.0.smithi084.stdout:./197/.snap/snap-subdir-test 2024-04-14T11:01:03.564 INFO:tasks.workunit.client.0.smithi084.stdout:./216/.snap/snap-subdir-test 2024-04-14T11:01:04.234 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:01:04.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:01:04.248 INFO:tasks.workunit.client.0.smithi084.stdout:./254/.snap/snap-subdir-test 2024-04-14T11:01:04.256 INFO:tasks.workunit.client.0.smithi084.stdout:./113/.snap/snap-subdir-test 2024-04-14T11:01:04.265 INFO:tasks.workunit.client.0.smithi084.stdout:./152/.snap/snap-subdir-test 2024-04-14T11:01:04.273 INFO:tasks.workunit.client.0.smithi084.stdout:./121/.snap/snap-subdir-test 2024-04-14T11:01:04.281 INFO:tasks.workunit.client.0.smithi084.stdout:./118/.snap/snap-subdir-test 2024-04-14T11:01:04.290 INFO:tasks.workunit.client.0.smithi084.stdout:./196/.snap/snap-subdir-test 2024-04-14T11:01:04.298 INFO:tasks.workunit.client.0.smithi084.stdout:./124/.snap/snap-subdir-test 2024-04-14T11:01:04.306 INFO:tasks.workunit.client.0.smithi084.stdout:./239/.snap/snap-subdir-test 2024-04-14T11:01:04.315 INFO:tasks.workunit.client.0.smithi084.stdout:./188/.snap/snap-subdir-test 2024-04-14T11:01:04.323 INFO:tasks.workunit.client.0.smithi084.stdout:./287/.snap/snap-subdir-test 2024-04-14T11:01:04.331 INFO:tasks.workunit.client.0.smithi084.stdout:./275/.snap/snap-subdir-test 2024-04-14T11:01:04.339 INFO:tasks.workunit.client.0.smithi084.stdout:./259/.snap/snap-subdir-test 2024-04-14T11:01:04.346 INFO:tasks.workunit.client.0.smithi084.stdout:./224/.snap/snap-subdir-test 2024-04-14T11:01:04.354 INFO:tasks.workunit.client.0.smithi084.stdout:./264/.snap/snap-subdir-test 2024-04-14T11:01:04.362 INFO:tasks.workunit.client.0.smithi084.stdout:./145/.snap/snap-subdir-test 2024-04-14T11:01:04.370 INFO:tasks.workunit.client.0.smithi084.stdout:./279/.snap/snap-subdir-test 2024-04-14T11:01:04.378 INFO:tasks.workunit.client.0.smithi084.stdout:./263/.snap/snap-subdir-test 2024-04-14T11:01:04.387 INFO:tasks.workunit.client.0.smithi084.stdout:./130/.snap/snap-subdir-test 2024-04-14T11:01:04.395 INFO:tasks.workunit.client.0.smithi084.stdout:./193/.snap/snap-subdir-test 2024-04-14T11:01:04.403 INFO:tasks.workunit.client.0.smithi084.stdout:./223/.snap/snap-subdir-test 2024-04-14T11:01:04.411 INFO:tasks.workunit.client.0.smithi084.stdout:./207/.snap/snap-subdir-test 2024-04-14T11:01:04.419 INFO:tasks.workunit.client.0.smithi084.stdout:./276/.snap/snap-subdir-test 2024-04-14T11:01:04.427 INFO:tasks.workunit.client.0.smithi084.stdout:./271/.snap/snap-subdir-test 2024-04-14T11:01:04.435 INFO:tasks.workunit.client.0.smithi084.stdout:./251/.snap/snap-subdir-test 2024-04-14T11:01:04.443 INFO:tasks.workunit.client.0.smithi084.stdout:./175/.snap/snap-subdir-test 2024-04-14T11:01:04.452 INFO:tasks.workunit.client.0.smithi084.stdout:./222/.snap/snap-subdir-test 2024-04-14T11:01:04.459 INFO:tasks.workunit.client.0.smithi084.stdout:./220/.snap/snap-subdir-test 2024-04-14T11:01:04.469 INFO:tasks.workunit.client.0.smithi084.stdout:./203/.snap/snap-subdir-test 2024-04-14T11:01:04.475 INFO:tasks.workunit.client.0.smithi084.stdout:./181/.snap/snap-subdir-test 2024-04-14T11:01:04.482 INFO:tasks.workunit.client.0.smithi084.stdout:./286/.snap/snap-subdir-test 2024-04-14T11:01:04.491 INFO:tasks.workunit.client.0.smithi084.stdout:./127/.snap/snap-subdir-test 2024-04-14T11:01:04.502 INFO:tasks.workunit.client.0.smithi084.stdout:./108/.snap/snap-subdir-test 2024-04-14T11:01:04.510 INFO:tasks.workunit.client.0.smithi084.stdout:./183/.snap/snap-subdir-test 2024-04-14T11:01:04.519 INFO:tasks.workunit.client.0.smithi084.stdout:./294/.snap/snap-subdir-test 2024-04-14T11:01:04.526 INFO:tasks.workunit.client.0.smithi084.stdout:./235/.snap/snap-subdir-test 2024-04-14T11:01:04.535 INFO:tasks.workunit.client.0.smithi084.stdout:./177/.snap/snap-subdir-test 2024-04-14T11:01:04.544 INFO:tasks.workunit.client.0.smithi084.stdout:./169/.snap/snap-subdir-test 2024-04-14T11:01:04.552 INFO:tasks.workunit.client.0.smithi084.stdout:./212/.snap/snap-subdir-test 2024-04-14T11:01:04.560 INFO:tasks.workunit.client.0.smithi084.stdout:./154/.snap/snap-subdir-test 2024-04-14T11:01:04.569 INFO:tasks.workunit.client.0.smithi084.stdout:./171/.snap/snap-subdir-test 2024-04-14T11:01:04.577 INFO:tasks.workunit.client.0.smithi084.stdout:./139/.snap/snap-subdir-test 2024-04-14T11:01:04.585 INFO:tasks.workunit.client.0.smithi084.stdout:./102/.snap/snap-subdir-test 2024-04-14T11:01:04.593 INFO:tasks.workunit.client.0.smithi084.stdout:./129/.snap/snap-subdir-test 2024-04-14T11:01:07.065 INFO:tasks.workunit.client.0.smithi084.stdout:Delete all the files and directories ... 2024-04-14T11:01:22.456 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T11:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.571+0000 7f32a8a80640 1 Processor -- start 2024-04-14T11:01:22.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.572+0000 7f32a8a80640 1 -- start start 2024-04-14T11:01:22.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.572+0000 7f32a8a80640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32a4155160 0x7f32a40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.572+0000 7f32a8a80640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32a40b3930 0x7f32a40cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.572+0000 7f32a8a80640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a40ccd90 con 0x7f32a415afc0 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.572+0000 7f32a8a80640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f32a415e4d0 con 0x7f32a4155160 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.572+0000 7f32a8a80640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f32a415e7b0 con 0x7f32a40b3930 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f32a4155160 0x7f32a40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a2d9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f32a415afc0 0x7f32a415b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54198/0 (socket says 172.21.15.84:54198) 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a2d9d640 1 -- 172.21.15.84:0/837386943 learned_addr learned my addr 172.21.15.84:0/837386943 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a1d9b640 1 --2- 172.21.15.84:0/837386943 >> v2:172.21.15.175:3300/0 conn(0x7f32a40b3930 0x7f32a40cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a259c640 1 -- 172.21.15.84:0/837386943 >> v2:172.21.15.175:3300/0 conn(0x7f32a40b3930 msgr2=0x7f32a40cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a259c640 1 --2- 172.21.15.84:0/837386943 >> v2:172.21.15.175:3300/0 conn(0x7f32a40b3930 0x7f32a40cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a259c640 1 -- 172.21.15.84:0/837386943 >> v1:172.21.15.84:6789/0 conn(0x7f32a415afc0 legacy=0x7f32a415b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a159a640 1 -- 172.21.15.84:0/837386943 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944749551 0 0) 0x7f32a40ccd90 con 0x7f32a415afc0 2024-04-14T11:01:22.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.573+0000 7f32a259c640 1 -- 172.21.15.84:0/837386943 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a415ea90 con 0x7f32a4155160 2024-04-14T11:01:22.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.574+0000 7f32a259c640 1 --2- 172.21.15.84:0/837386943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4155160 0x7f32a40cb3d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f32a40c4150 tx=0x7f329802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a20fe4c4facbf32 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.574+0000 7f32a159a640 1 -- 172.21.15.84:0/837386943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298034070 con 0x7f32a4155160 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.574+0000 7f32a159a640 1 -- 172.21.15.84:0/837386943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3298030610 con 0x7f32a4155160 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.574+0000 7f32a159a640 1 -- 172.21.15.84:0/837386943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32980309e0 con 0x7f32a4155160 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.574+0000 7f32a8a80640 1 -- 172.21.15.84:0/837386943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4155160 msgr2=0x7f32a40cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.574+0000 7f32a8a80640 1 --2- 172.21.15.84:0/837386943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4155160 0x7f32a40cb3d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f32a40c4150 tx=0x7f329802b960 comp rx=0 tx=0).stop 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.575+0000 7f32a8a80640 1 -- 172.21.15.84:0/837386943 shutdown_connections 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.575+0000 7f32a8a80640 1 --2- 172.21.15.84:0/837386943 >> v2:172.21.15.175:3300/0 conn(0x7f32a40b3930 0x7f32a40cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.575+0000 7f32a8a80640 1 --2- 172.21.15.84:0/837386943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a4155160 0x7f32a40cb3d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.575+0000 7f32a8a80640 1 -- 172.21.15.84:0/837386943 >> 172.21.15.84:0/837386943 conn(0x7f32a406b900 msgr2=0x7f32a406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.575+0000 7f32a8a80640 1 -- 172.21.15.84:0/837386943 shutdown_connections 2024-04-14T11:01:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.575+0000 7f32a8a80640 1 -- 172.21.15.84:0/837386943 wait complete. 2024-04-14T11:01:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.576+0000 7f32a8a80640 1 Processor -- start 2024-04-14T11:01:22.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.576+0000 7f32a8a80640 1 -- start start 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40b3930 0x7f32a4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4155160 0x7f32a4154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 0x7f32a4150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4155540 con 0x7f32a415afc0 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32a415f050 con 0x7f32a40b3930 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f32a40cc150 con 0x7f32a4155160 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 0x7f32a4150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 0x7f32a4150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54624/0 (socket says 172.21.15.84:54624) 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 -- 172.21.15.84:0/191990019 learned_addr learned my addr 172.21.15.84:0/191990019 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a259c640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40b3930 0x7f32a4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a1d9b640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4155160 0x7f32a4154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 -- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4155160 msgr2=0x7f32a4154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4155160 0x7f32a4154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 -- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40b3930 msgr2=0x7f32a4155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40b3930 0x7f32a4155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 -- 172.21.15.84:0/191990019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a41583f0 con 0x7f32a415afc0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a2d9d640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 0x7f32a4150a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c7b0 tx=0x7f329c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c018070 con 0x7f32a415afc0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c00a640 con 0x7f32a415afc0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a41f0840 con 0x7f32a415afc0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c00ce60 con 0x7f32a415afc0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.577+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a41f0b00 con 0x7f32a415afc0 2024-04-14T11:01:22.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.578+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a4069c30 con 0x7f32a415afc0 2024-04-14T11:01:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.579+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f329c01b070 con 0x7f32a415afc0 2024-04-14T11:01:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.579+0000 7f3292ffd640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f328406c8f0 0x7f328406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.579+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5956+0+0 (secure 0 0 0) 0x7f329c08b120 con 0x7f32a415afc0 2024-04-14T11:01:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.579+0000 7f32a259c640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f328406c8f0 0x7f328406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.580+0000 7f32a259c640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f328406c8f0 0x7f328406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3298036000 tx=0x7f3298008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.584+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f329c058df0 con 0x7f32a415afc0 2024-04-14T11:01:22.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.796+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32a40cbf30 con 0x7f32a415afc0 2024-04-14T11:01:22.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.797+0000 7f3292ffd640 1 -- 172.21.15.84:0/191990019 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7f329c05d0f0 con 0x7f32a415afc0 2024-04-14T11:01:22.792 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:01:22.792 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T11:01:22.793 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T11:01:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f328406c8f0 msgr2=0x7f328406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f328406c8f0 0x7f328406edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3298036000 tx=0x7f3298008030 comp rx=0 tx=0).stop 2024-04-14T11:01:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 msgr2=0x7f32a4150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 0x7f32a4150a20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f329c00c7b0 tx=0x7f329c00cc70 comp rx=0 tx=0).stop 2024-04-14T11:01:22.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 shutdown_connections 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f328406c8f0 0x7f328406edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f32a415afc0 0x7f32a4150a20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f32a4155160 0x7f32a4154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 --2- 172.21.15.84:0/191990019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a40b3930 0x7f32a4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 >> 172.21.15.84:0/191990019 conn(0x7f32a406b900 msgr2=0x7f32a40d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 shutdown_connections 2024-04-14T11:01:22.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.799+0000 7f32a8a80640 1 -- 172.21.15.84:0/191990019 wait complete. 2024-04-14T11:01:22.805 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4308 quiesce db --set-id 997e9b42 --release --await' 2024-04-14T11:01:22.805 DEBUG:teuthology.orchestra.run.smithi084:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4308 quiesce db --set-id 997e9b42 --release --await 2024-04-14T11:01:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.916+0000 7fa3ce915640 1 Processor -- start 2024-04-14T11:01:22.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.916+0000 7fa3ce915640 1 -- start start 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3ce915640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3c80681f0 0x7fa3c8067720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3ce915640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3c8067c60 0x7fa3c815e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3ce915640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c806bba0 con 0x7fa3c8155190 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3ce915640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c806cb40 con 0x7fa3c80681f0 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3ce915640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c815e530 con 0x7fa3c8067c60 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3c80681f0 0x7fa3c8067720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c7fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa3c8155190 0x7fa3c815b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54204/0 (socket says 172.21.15.84:54204) 2024-04-14T11:01:22.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c77fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa3c80681f0 0x7fa3c8067720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54628/0 (socket says 172.21.15.84:54628) 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c7fff640 1 -- 172.21.15.84:0/1302808083 learned_addr learned my addr 172.21.15.84:0/1302808083 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/1302808083 >> v2:172.21.15.175:3300/0 conn(0x7fa3c8067c60 0x7fa3c815e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c77fe640 1 -- 172.21.15.84:0/1302808083 >> v2:172.21.15.175:3300/0 conn(0x7fa3c8067c60 msgr2=0x7fa3c815e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/1302808083 >> v2:172.21.15.175:3300/0 conn(0x7fa3c8067c60 0x7fa3c815e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c77fe640 1 -- 172.21.15.84:0/1302808083 >> v1:172.21.15.84:6789/0 conn(0x7fa3c8155190 legacy=0x7fa3c815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3c77fe640 1 -- 172.21.15.84:0/1302808083 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c806c280 con 0x7fa3c80681f0 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.917+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/1302808083 >> v2:172.21.15.175:3300/0 conn(0x7fa3c8067c60 0x7fa3c815e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.918+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/1302808083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80681f0 0x7fa3c8067720 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa3c815c080 tx=0x7fa3bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1780c75bb16bf57 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.918+0000 7fa3c6ffd640 1 -- 172.21.15.84:0/1302808083 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0315a0 con 0x7fa3c80681f0 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.918+0000 7fa3c6ffd640 1 -- 172.21.15.84:0/1302808083 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc037070 con 0x7fa3c80681f0 2024-04-14T11:01:22.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.918+0000 7fa3c6ffd640 1 -- 172.21.15.84:0/1302808083 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc031960 con 0x7fa3c80681f0 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 -- 172.21.15.84:0/1302808083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80681f0 msgr2=0x7fa3c8067720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 --2- 172.21.15.84:0/1302808083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80681f0 0x7fa3c8067720 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa3c815c080 tx=0x7fa3bc02b840 comp rx=0 tx=0).stop 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 -- 172.21.15.84:0/1302808083 shutdown_connections 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 --2- 172.21.15.84:0/1302808083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c80681f0 0x7fa3c8067720 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 --2- 172.21.15.84:0/1302808083 >> v2:172.21.15.175:3300/0 conn(0x7fa3c8067c60 0x7fa3c815e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 -- 172.21.15.84:0/1302808083 >> 172.21.15.84:0/1302808083 conn(0x7fa3c80c9e70 msgr2=0x7fa3c80ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 -- 172.21.15.84:0/1302808083 shutdown_connections 2024-04-14T11:01:22.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.919+0000 7fa3ce915640 1 -- 172.21.15.84:0/1302808083 wait complete. 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.920+0000 7fa3ce915640 1 Processor -- start 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.920+0000 7fa3ce915640 1 -- start start 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 0x7fa3c80c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3c80681f0 0x7fa3c80c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3c8155190 0x7fa3c80c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c806d070 con 0x7fa3c8067c60 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c806cd90 con 0x7fa3c8155190 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c8155570 con 0x7fa3c80681f0 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 0x7fa3c80c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 0x7fa3c80c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54640/0 (socket says 172.21.15.84:54640) 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3972954 learned_addr learned my addr 172.21.15.84:0/3972954 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3c80681f0 0x7fa3c80c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3c8155190 0x7fa3c80c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3c80681f0 msgr2=0x7fa3c80c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3c80681f0 0x7fa3c80c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3c8155190 msgr2=0x7fa3c80c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3c8155190 0x7fa3c80c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3972954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c814a7d0 con 0x7fa3c8067c60 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 0x7fa3c80c7c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c430 tx=0x7fa3b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c4ff9640 1 -- 172.21.15.84:0/3972954 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8017070 con 0x7fa3c8067c60 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c4ff9640 1 -- 172.21.15.84:0/3972954 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b8005ce0 con 0x7fa3c8067c60 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c814ad20 con 0x7fa3c8067c60 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3c4ff9640 1 -- 172.21.15.84:0/3972954 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80072f0 con 0x7fa3c8067c60 2024-04-14T11:01:22.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.921+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c81f1aa0 con 0x7fa3c8067c60 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.923+0000 7fa3c4ff9640 1 -- 172.21.15.84:0/3972954 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3b801a070 con 0x7fa3c8067c60 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.923+0000 7fa3c4ff9640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa3b406c920 0x7fa3b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.924+0000 7fa3c4ff9640 1 -- 172.21.15.84:0/3972954 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5956+0+0 (secure 0 0 0) 0x7fa3b808af30 con 0x7fa3c8067c60 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.924+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa3b406c920 0x7fa3b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.924+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa3b406c920 0x7fa3b406ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc036000 tx=0x7fa3bc03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.924+0000 7fa3d17d1740 1 Processor -- start 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.924+0000 7fa3d17d1740 1 -- start start 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d9647332f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96470ba20 0x55d964708e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d964753980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d96466f340 con 0x55d964749920 2024-04-14T11:01:22.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d964615ae0 con 0x55d964732f10 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55d96466b300 con 0x55d96470ba20 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d964753980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d964753980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54646/0 (socket says 172.21.15.84:54646) 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 -- 172.21.15.84:0/2151970541 learned_addr learned my addr 172.21.15.84:0/2151970541 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d9647332f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 -- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96470ba20 msgr2=0x55d964708e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96470ba20 0x55d964708e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96470ba20 0x55d964708e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 -- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 msgr2=0x55d9647332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d9647332f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3cceb2640 1 -- 172.21.15.84:0/2151970541 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d964381920 con 0x55d964749920 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.925+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d9647332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d964753980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000f4f0 tx=0x7fa3c000f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2191ac6b3f90aef server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3adffb640 1 -- 172.21.15.84:0/2151970541 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c001c070 con 0x55d964749920 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3adffb640 1 -- 172.21.15.84:0/2151970541 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c000d780 con 0x55d964749920 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3adffb640 1 -- 172.21.15.84:0/2151970541 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000db30 con 0x55d964749920 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 -- 172.21.15.84:0/2151970541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 msgr2=0x55d964753980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d964753980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000f4f0 tx=0x7fa3c000f9b0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 -- 172.21.15.84:0/2151970541 shutdown_connections 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d964753980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96470ba20 0x55d964708e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/2151970541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d9647332f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 -- 172.21.15.84:0/2151970541 >> 172.21.15.84:0/2151970541 conn(0x55d9646d13b0 msgr2=0x55d96470a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 -- 172.21.15.84:0/2151970541 shutdown_connections 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.926+0000 7fa3d17d1740 1 -- 172.21.15.84:0/2151970541 wait complete. 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.927+0000 7fa3d17d1740 1 -- start start 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.927+0000 7fa3d17d1740 1 Processor -- start 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d964747f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964749920 0x55d96472e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 0x55d96472cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d964628ea0 con 0x55d96474e1a0 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55d964733830 con 0x55d964732f10 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55d96474c010 con 0x55d964749920 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3d17d1740 10 client.0 _ll_register_callbacks cb 0x55d96462d430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 0x55d96472cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 0x55d96472cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54650/0 (socket says 172.21.15.84:54650) 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 -- 172.21.15.84:0/3548598901 learned_addr learned my addr 172.21.15.84:0/3548598901 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d964747f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964749920 0x55d96472e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 -- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964749920 msgr2=0x55d96472e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964749920 0x55d96472e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 -- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 msgr2=0x55d964747f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d964747f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 -- 172.21.15.84:0/3548598901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96444dd30 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 0x55d96472cf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0016000 tx=0x7fa3c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b840dcfa7481e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.928+0000 7fa3a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3548598901 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c001c050 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3548598901 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 5956+0+0 (secure 0 0 0) 0x7fa3c000dd40 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3c000d780 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3548598901 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fa3c0030050 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 10 client.5073 fetch_fsmap learned FSMap version 13 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55d96472dfb0 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3548598901 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c000d780 con 0x55d96474e1a0 2024-04-14T11:01:22.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3548598901 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fa3c0033020 con 0x55d96474e1a0 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 10 client.5073 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 10 client.5073 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 20 client.5073 populate_metadata read hostname 'smithi084' 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964730480 0x55d96472d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 4 client.5073 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d96460e920 con 0x55d964730480 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.929+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964730480 0x55d96472d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.930+0000 7fa3a6ffd640 10 client.5073 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.930+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964730480 0x55d96472d470 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca4ef165605c17d9 server_cookie=2f31c73c9d5840b2 in_seq=0 out_seq=0 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.930+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3548598901 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d96460e920 con 0x55d964730480 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.930+0000 7fa3a6ffd640 10 client.5073 handle_command_reply: tid=0 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.930+0000 7fa3d17d1740 1 client.5073 shutdown 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 msgr2=0x55d96472cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 0x55d96472cf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0016000 tx=0x7fa3c0004ab0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 shutdown_connections 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964730480 0x55d96472d470 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d96474e1a0 0x55d96472cf30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964749920 0x55d96472e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3a6ffd640 0 client.5073 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3548598901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964732f10 0x55d964747f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 >> 172.21.15.84:0/3548598901 conn(0x55d9646d13b0 msgr2=0x55d96470a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 shutdown_connections 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3548598901 wait complete. 2024-04-14T11:01:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.931+0000 7fa3d17d1740 20 client.5073 trim_cache size 0 max 16384 2024-04-14T11:01:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 Processor -- start 2024-04-14T11:01:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 -- start start 2024-04-14T11:01:22.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964732f10 0x55d964707d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d96472cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d96474e1a0 0x55d96472d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81fe3f0 con 0x55d964749920 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81fd650 con 0x55d96474e1a0 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c81fdd20 con 0x55d964732f10 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3c77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d96472cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3c77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d96472cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54662/0 (socket says 172.21.15.84:54662) 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.948+0000 7fa3c77fe640 1 -- 172.21.15.84:0/805290473 learned_addr learned my addr 172.21.15.84:0/805290473 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964732f10 0x55d964707d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d96474e1a0 0x55d96472d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c77fe640 1 -- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964732f10 msgr2=0x55d964707d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964732f10 0x55d964707d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c77fe640 1 -- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d96474e1a0 msgr2=0x55d96472d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d96474e1a0 0x55d96472d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c77fe640 1 -- 172.21.15.84:0/805290473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d964706d80 con 0x55d964749920 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d96472cd00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009890 tx=0x7fa3bc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0ee2e090682c74 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3ad7fa640 1 -- 172.21.15.84:0/805290473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc055070 con 0x55d964749920 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3ad7fa640 1 -- 172.21.15.84:0/805290473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc037040 con 0x55d964749920 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.949+0000 7fa3ad7fa640 1 -- 172.21.15.84:0/805290473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc003ae0 con 0x55d964749920 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 -- 172.21.15.84:0/805290473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 msgr2=0x55d96472cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d96472cd00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009890 tx=0x7fa3bc030000 comp rx=0 tx=0).stop 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 -- 172.21.15.84:0/805290473 shutdown_connections 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d96474e1a0 0x55d96472d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964749920 0x55d96472cd00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/805290473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d964732f10 0x55d964707d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 -- 172.21.15.84:0/805290473 >> 172.21.15.84:0/805290473 conn(0x55d9646d13b0 msgr2=0x55d964747d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:22.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 -- 172.21.15.84:0/805290473 shutdown_connections 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 -- 172.21.15.84:0/805290473 wait complete. 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 -- start start 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.950+0000 7fa3d17d1740 1 Processor -- start 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 0x55d964731030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964749920 0x55d9647bed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96474e1a0 0x55d964708a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81f42a0 con 0x55d964732f10 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c81f4fa0 con 0x55d964749920 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa3c81f48f0 con 0x55d96474e1a0 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3d17d1740 10 client.0 _ll_register_callbacks cb 0x7fa3c001a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 0x55d964731030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 0x55d964731030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54672/0 (socket says 172.21.15.84:54672) 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3818491736 learned_addr learned my addr 172.21.15.84:0/3818491736 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:01:22.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3cceb2640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96474e1a0 0x55d964708a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964749920 0x55d9647bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96474e1a0 msgr2=0x55d964708a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96474e1a0 0x55d964708a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964749920 msgr2=0x55d9647bed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964749920 0x55d9647bed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c7fff640 1 -- 172.21.15.84:0/3818491736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96460e920 con 0x55d964732f10 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.951+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964749920 0x55d9647bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3c7fff640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 0x55d964731030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8058c30 tx=0x7fa3b800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420c667f7009e80e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3818491736 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8055310 con 0x55d964732f10 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3818491736 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 5956+0+0 (secure 0 0 0) 0x7fa3b8007490 con 0x55d964732f10 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3bc037040 con 0x55d964732f10 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3818491736 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fa3b80554b0 con 0x55d964732f10 2024-04-14T11:01:22.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 10 client.5079 fetch_fsmap learned FSMap version 13 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55d96472d590 con 0x55d964732f10 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3818491736 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3bc037040 con 0x55d964732f10 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3818491736 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fa3b80580f0 con 0x55d964732f10 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 10 client.5079 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 10 client.5079 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 20 client.5079 populate_metadata read hostname 'smithi084' 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964723b80 0x55d964708f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 4 client.5079 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "997e9b42", "release": true, "await": true}] 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "quiesce db", "set_id": "997e9b42", "release": true, "await": true}) -- 0x55d96467cd60 con 0x55d964723b80 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.952+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964723b80 0x55d964708f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.953+0000 7fa3c77fe640 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964723b80 0x55d964708f80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6138a06c947790d5 server_cookie=93aec3711e89b4b1 in_seq=0 out_seq=0 2024-04-14T11:01:22.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:22.953+0000 7fa3a6ffd640 10 client.5079 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:23.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.188+0000 7fa3a6ffd640 1 -- 172.21.15.84:0/3818491736 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55d96467cd60 con 0x55d964723b80 2024-04-14T11:01:23.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.188+0000 7fa3a6ffd640 10 client.5079 handle_command_reply: tid=0 2024-04-14T11:01:23.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.188+0000 7fa3d17d1740 1 client.5079 shutdown 2024-04-14T11:01:23.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 msgr2=0x55d964731030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 0x55d964731030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8058c30 tx=0x7fa3b800a000 comp rx=0 tx=0).stop 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 shutdown_connections 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55d964723b80 0x55d964708f80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d96474e1a0 0x55d964708a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d964749920 0x55d9647bed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3a6ffd640 0 client.5079 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 --2- 172.21.15.84:0/3818491736 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d964732f10 0x55d964731030 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 >> 172.21.15.84:0/3818491736 conn(0x55d9646d13b0 msgr2=0x55d96472f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 shutdown_connections 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 1 -- 172.21.15.84:0/3818491736 wait complete. 2024-04-14T11:01:23.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3d17d1740 20 client.5079 trim_cache size 0 max 16384 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 13, 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 4308, 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 8, 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "997e9b42": { 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 8, 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T11:01:23.186 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 30.0, 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 80.7, 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RELEASED", 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:01:23.187 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T11:01:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa3b406c920 msgr2=0x7fa3b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa3b406c920 0x7fa3b406ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc036000 tx=0x7fa3bc03d040 comp rx=0 tx=0).stop 2024-04-14T11:01:23.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 msgr2=0x7fa3c80c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 0x7fa3c80c7c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c430 tx=0x7fa3b800c8f0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 shutdown_connections 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa3b406c920 0x7fa3b406ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3c8155190 0x7fa3c80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.189+0000 7fa3ce915640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3c80681f0 0x7fa3c80c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.190+0000 7fa3ce915640 1 --2- 172.21.15.84:0/3972954 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3c8067c60 0x7fa3c80c7c10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.190+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 >> 172.21.15.84:0/3972954 conn(0x7fa3c80c9e70 msgr2=0x7fa3c80cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.190+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 shutdown_connections 2024-04-14T11:01:23.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:01:23.190+0000 7fa3ce915640 1 -- 172.21.15.84:0/3972954 wait complete. 2024-04-14T11:01:23.197 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 997e9b42, seconds elapsed: 22.7 2024-04-14T11:01:23.754 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/19' 2024-04-14T11:01:23.754 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/15' 2024-04-14T11:01:23.754 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/31' 2024-04-14T11:01:23.754 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/36' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/20' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/12' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/39' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/10' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/34' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/38' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/11' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/16' 2024-04-14T11:01:23.755 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/32' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/30' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/14' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/18' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/13' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/33' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/17' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/35' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed './100/37' 2024-04-14T11:01:23.756 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './100' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/19' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/15' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/31' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/36' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/20' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/12' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/39' 2024-04-14T11:01:23.757 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/10' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/34' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/38' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/11' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/16' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/32' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/30' 2024-04-14T11:01:23.758 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/14' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/18' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/13' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/33' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/17' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/35' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './101/37' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './101' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/19' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/15' 2024-04-14T11:01:23.759 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/31' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/36' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/20' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/12' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/39' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/10' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/34' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/38' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/11' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/16' 2024-04-14T11:01:23.760 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/32' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/30' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/14' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/18' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/13' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/33' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/17' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/35' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './102/37' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './102' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/19' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/15' 2024-04-14T11:01:23.761 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/31' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/36' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/20' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/12' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/39' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/10' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/34' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/38' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/11' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/16' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/32' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/30' 2024-04-14T11:01:23.762 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/14' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/18' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/13' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/33' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/17' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/35' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './103/37' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './103' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/19' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/15' 2024-04-14T11:01:23.763 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/31' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/36' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/20' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/12' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/39' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/10' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/34' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/38' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/11' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/16' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/32' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/30' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/14' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/18' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/13' 2024-04-14T11:01:23.764 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/33' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/17' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/35' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './104/37' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './104' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/19' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/15' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/31' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/36' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/20' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/12' 2024-04-14T11:01:23.765 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/39' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/10' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/34' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/38' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/11' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/16' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/32' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/30' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/14' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/18' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/13' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/33' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/17' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/35' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed './105/37' 2024-04-14T11:01:23.766 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './105' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/19' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/15' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/31' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/36' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/20' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/12' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/39' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/10' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/34' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/38' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/11' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/16' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/32' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/30' 2024-04-14T11:01:23.767 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/14' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/18' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/13' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/33' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/17' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/35' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './106/37' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './106' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/19' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/15' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/31' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/36' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/20' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/12' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/39' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/10' 2024-04-14T11:01:23.768 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/34' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/38' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/11' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/16' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/32' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/30' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/14' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/18' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/13' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/33' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/17' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/35' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './107/37' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './107' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/19' 2024-04-14T11:01:23.769 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/15' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/31' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/36' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/20' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/12' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/39' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/10' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/34' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/38' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/11' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/16' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/32' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/30' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/14' 2024-04-14T11:01:23.770 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/18' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/13' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/33' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/17' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/35' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './108/37' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './108' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/19' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/15' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/31' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/36' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/20' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/12' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/39' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/10' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/34' 2024-04-14T11:01:23.771 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/38' 2024-04-14T11:01:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/11' 2024-04-14T11:01:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/16' 2024-04-14T11:01:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/32' 2024-04-14T11:01:23.772 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/30' 2024-04-14T11:01:24.339 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/14' 2024-04-14T11:01:24.339 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/18' 2024-04-14T11:01:24.339 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/13' 2024-04-14T11:01:24.339 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/33' 2024-04-14T11:01:24.339 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/17' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/35' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './109/37' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './109' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/19' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/15' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/31' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/36' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/20' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/12' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/39' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/10' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/34' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/38' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/11' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/16' 2024-04-14T11:01:24.340 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/32' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/30' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/14' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/18' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/13' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/33' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/17' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/35' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './110/37' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './110' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/19' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/15' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/31' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/36' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/20' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/12' 2024-04-14T11:01:24.341 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/39' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/10' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/34' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/38' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/11' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/16' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/32' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/30' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/14' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/18' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/13' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/33' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/17' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/35' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed './111/37' 2024-04-14T11:01:24.342 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './111' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/19' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/15' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/31' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/36' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/20' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/12' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/39' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/10' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/34' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/38' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/11' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/16' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/32' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/30' 2024-04-14T11:01:24.343 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/14' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/18' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/13' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/33' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/17' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/35' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './112/37' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './112' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/19' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/15' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/31' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/36' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/20' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/12' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/39' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/10' 2024-04-14T11:01:24.344 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/34' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/38' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/11' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/16' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/32' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/30' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/14' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/18' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/13' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/33' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/17' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/35' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './113/37' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './113' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/19' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/15' 2024-04-14T11:01:24.345 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/31' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/36' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/20' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/12' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/39' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/10' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/34' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/38' 2024-04-14T11:01:24.346 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/11' 2024-04-14T11:01:24.348 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/16' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/32' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/30' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/14' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/18' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/13' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/33' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/17' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/35' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './114/37' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './114' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/19' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/15' 2024-04-14T11:01:24.349 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/31' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/36' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/20' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/12' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/39' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/10' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/34' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/38' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/11' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/16' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/32' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/30' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/14' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/18' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/13' 2024-04-14T11:01:24.350 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/33' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/17' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/35' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './115/37' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './115' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/19' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/15' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/31' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/36' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/20' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/12' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/39' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/10' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/34' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/38' 2024-04-14T11:01:24.351 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/11' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/16' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/32' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/30' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/14' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/18' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/13' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/33' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/17' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/35' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './116/37' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './116' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/19' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/15' 2024-04-14T11:01:24.352 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/31' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/36' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/20' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/12' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/39' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/10' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/34' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/38' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/11' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/16' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/32' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/30' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/14' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/18' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/13' 2024-04-14T11:01:24.353 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/33' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/17' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/35' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './117/37' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './117' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/19' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/15' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/31' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/36' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/20' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/12' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/39' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/10' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/34' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/38' 2024-04-14T11:01:24.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/11' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/16' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/32' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/30' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/14' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/18' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/13' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/33' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/17' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/35' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './118/37' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './118' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/19' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/15' 2024-04-14T11:01:24.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/31' 2024-04-14T11:01:24.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/36' 2024-04-14T11:01:24.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/20' 2024-04-14T11:01:24.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/12' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/39' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/10' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/34' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/38' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/11' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/16' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/32' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/30' 2024-04-14T11:01:24.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/14' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/18' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/13' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/33' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/17' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/35' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './119/37' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './119' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/19' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/15' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/31' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/36' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/20' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/12' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/39' 2024-04-14T11:01:24.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/10' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/34' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/38' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/11' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/16' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/32' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/30' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/14' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/18' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/13' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/33' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/17' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/35' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './120/37' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './120' 2024-04-14T11:01:24.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/19' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/15' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/31' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/36' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/20' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/12' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/39' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/10' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/34' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/38' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/11' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/16' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/32' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/30' 2024-04-14T11:01:24.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/14' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/18' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/13' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/33' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/17' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/35' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './121/37' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './121' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/19' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/15' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/31' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/36' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/20' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/12' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/39' 2024-04-14T11:01:24.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/10' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/34' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/38' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/11' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/16' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/32' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/30' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/14' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/18' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/13' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/33' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/17' 2024-04-14T11:01:24.842 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/35' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './122/37' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './122' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/19' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/15' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/31' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/36' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/20' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/12' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/39' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/10' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/34' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/38' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/11' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/16' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/32' 2024-04-14T11:01:24.843 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/30' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/14' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/18' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/13' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/33' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/17' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/35' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './123/37' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './123' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/19' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/15' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/31' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/36' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/20' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/12' 2024-04-14T11:01:24.844 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/39' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/10' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/34' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/38' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/11' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/16' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/32' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/30' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/14' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/18' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/13' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/33' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/17' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/35' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed './124/37' 2024-04-14T11:01:24.845 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './124' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/19' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/15' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/31' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/36' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/20' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/12' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/39' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/10' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/34' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/38' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/11' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/16' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/32' 2024-04-14T11:01:24.846 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/30' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/14' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/18' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/13' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/33' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/17' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/35' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './125/37' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './125' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/19' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/15' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/31' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/36' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/20' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/12' 2024-04-14T11:01:24.847 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/39' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/10' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/34' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/38' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/11' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/16' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/32' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/30' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/14' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/18' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/13' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/33' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/17' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/35' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed './126/37' 2024-04-14T11:01:24.848 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './126' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/19' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/15' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/31' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/36' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/20' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/12' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/39' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/10' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/34' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/38' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/11' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/16' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/32' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/30' 2024-04-14T11:01:24.849 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/14' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/18' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/13' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/33' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/17' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/35' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './127/37' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './127' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/19' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/15' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/31' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/36' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/20' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/12' 2024-04-14T11:01:24.850 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/39' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/10' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/34' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/38' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/11' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/16' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/32' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/30' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/14' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/18' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/13' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/33' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/17' 2024-04-14T11:01:24.851 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/35' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './128/37' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './128' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/19' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/15' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/31' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/36' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/20' 2024-04-14T11:01:25.354 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/12' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/39' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/10' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/34' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/38' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/11' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/16' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/32' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/30' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/14' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/18' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/13' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/33' 2024-04-14T11:01:25.355 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/17' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/35' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './129/37' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './129' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/19' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/15' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/31' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/36' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/20' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/12' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/39' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/10' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/34' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/38' 2024-04-14T11:01:25.356 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/11' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/16' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/32' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/30' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/14' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/18' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/13' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/33' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/17' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/35' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './130/37' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './130' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/19' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/15' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/31' 2024-04-14T11:01:25.357 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/36' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/20' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/12' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/39' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/10' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/34' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/38' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/11' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/16' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/32' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/30' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/14' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/18' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/13' 2024-04-14T11:01:25.358 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/33' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/17' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/35' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './131/37' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './131' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/19' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/15' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/31' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/36' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/20' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/12' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/39' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/10' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/34' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/38' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/11' 2024-04-14T11:01:25.359 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/16' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/32' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/30' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/14' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/18' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/13' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/33' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/17' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/35' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './132/37' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './132' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/19' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/15' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/31' 2024-04-14T11:01:25.360 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/36' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/20' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/12' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/39' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/10' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/34' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/38' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/11' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/16' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/32' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/30' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/14' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/18' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/13' 2024-04-14T11:01:25.361 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/33' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/17' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/35' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './133/37' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './133' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/19' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/15' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/31' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/36' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/20' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/12' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/39' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/10' 2024-04-14T11:01:25.362 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/34' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/38' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/11' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/16' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/32' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/30' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/14' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/18' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/13' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/33' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/17' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/35' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './134/37' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './134' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/19' 2024-04-14T11:01:25.363 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/15' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/31' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/36' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/20' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/12' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/39' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/10' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/34' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/38' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/11' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/16' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/32' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/30' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/14' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/18' 2024-04-14T11:01:25.364 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/13' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/33' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/17' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/35' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './135/37' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './135' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/19' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/15' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/31' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/36' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/20' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/12' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/39' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/10' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/34' 2024-04-14T11:01:25.365 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/38' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/11' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/16' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/32' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/30' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/14' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/18' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/13' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/33' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/17' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/35' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './136/37' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './136' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/19' 2024-04-14T11:01:25.366 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/15' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/31' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/36' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/20' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/12' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/39' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/10' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/34' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/38' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/11' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/16' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/32' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/30' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/14' 2024-04-14T11:01:25.367 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/18' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/13' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/33' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/17' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/35' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './137/37' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './137' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/19' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/15' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/31' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/36' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/20' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/12' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/39' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/10' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/34' 2024-04-14T11:01:25.368 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/38' 2024-04-14T11:01:25.369 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/11' 2024-04-14T11:01:25.369 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/16' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/32' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/30' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/14' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/18' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/13' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/33' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/17' 2024-04-14T11:01:25.905 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/35' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './138/37' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './138' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/19' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/15' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/31' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/36' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/20' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/12' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/39' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/10' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/34' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/38' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/11' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/16' 2024-04-14T11:01:25.906 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/32' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/30' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/14' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/18' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/13' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/33' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/17' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/35' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './139/37' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './139' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/19' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/15' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/31' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/36' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/20' 2024-04-14T11:01:25.907 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/12' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/39' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/10' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/34' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/38' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/11' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/16' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/32' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/30' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/14' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/18' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/13' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/33' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/17' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/35' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './140/37' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './140' 2024-04-14T11:01:25.908 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/19' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/15' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/31' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/36' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/20' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/12' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/39' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/10' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/34' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/38' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/11' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/16' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/32' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/30' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/14' 2024-04-14T11:01:25.909 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/18' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/13' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/33' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/17' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/35' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './141/37' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './141' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/19' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/15' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/31' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/36' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/20' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/12' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/39' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/10' 2024-04-14T11:01:25.910 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/34' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/38' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/11' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/16' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/32' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/30' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/14' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/18' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/13' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/33' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/17' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/35' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './142/37' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './142' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/19' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/15' 2024-04-14T11:01:25.911 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/31' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/36' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/20' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/12' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/39' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/10' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/34' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/38' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/11' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/16' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/32' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/30' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/14' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/18' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/13' 2024-04-14T11:01:25.912 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/33' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/17' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/35' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './143/37' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './143' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/19' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/15' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/31' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/36' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/20' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/12' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/39' 2024-04-14T11:01:25.913 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/10' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/34' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/38' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/11' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/16' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/32' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/30' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/14' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/18' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/13' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/33' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/17' 2024-04-14T11:01:25.914 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/35' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './144/37' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './144' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/19' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/15' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/31' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/36' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/20' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/12' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/39' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/10' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/34' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/38' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/11' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/16' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/32' 2024-04-14T11:01:25.915 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/30' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/14' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/18' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/13' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/33' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/17' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/35' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './145/37' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './145' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/19' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/15' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/31' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/36' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/20' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/12' 2024-04-14T11:01:25.916 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/39' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/10' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/34' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/38' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/11' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/16' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/32' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/30' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/14' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/18' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/13' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/33' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/17' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/35' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed './146/37' 2024-04-14T11:01:25.917 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './146' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/19' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/15' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/31' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/36' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/20' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/12' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/39' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/10' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/34' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/38' 2024-04-14T11:01:25.918 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/11' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/16' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/32' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/30' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/14' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/18' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/13' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/33' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/17' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/35' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './147/37' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './147' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/19' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/15' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/31' 2024-04-14T11:01:25.919 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/36' 2024-04-14T11:01:26.415 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/20' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/12' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/39' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/10' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/34' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/38' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/11' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/16' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/32' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/30' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/14' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/18' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/13' 2024-04-14T11:01:26.416 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/33' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/17' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/35' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './148/37' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './148' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/19' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/15' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/31' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/36' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/20' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/12' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/39' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/10' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/34' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/38' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/11' 2024-04-14T11:01:26.417 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/16' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/32' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/30' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/14' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/18' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/13' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/33' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/17' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/35' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './149/37' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './149' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/19' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/15' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/31' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/36' 2024-04-14T11:01:26.418 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/20' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/12' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/39' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/10' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/34' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/38' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/11' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/16' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/32' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/30' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/14' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/18' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/13' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/33' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/17' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/35' 2024-04-14T11:01:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:removed './150/37' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './150' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/19' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/15' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/31' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/36' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/20' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/12' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/39' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/10' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/34' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/38' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/11' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/16' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/32' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/30' 2024-04-14T11:01:26.420 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/14' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/18' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/13' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/33' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/17' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/35' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './151/37' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './151' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/19' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/15' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/31' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/36' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/20' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/12' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/39' 2024-04-14T11:01:26.421 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/10' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/34' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/38' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/11' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/16' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/32' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/30' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/14' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/18' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/13' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/33' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/17' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/35' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './152/37' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './152' 2024-04-14T11:01:26.422 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/19' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/15' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/31' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/36' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/20' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/12' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/39' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/10' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/34' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/38' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/11' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/16' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/32' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/30' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/14' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/18' 2024-04-14T11:01:26.423 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/13' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/33' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/17' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/35' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './153/37' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './153' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/19' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/15' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/31' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/36' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/20' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/12' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/39' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/10' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/34' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/38' 2024-04-14T11:01:26.424 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/11' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/16' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/32' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/30' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/14' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/18' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/13' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/33' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/17' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/35' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './154/37' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './154' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/19' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/15' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/31' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/36' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/20' 2024-04-14T11:01:26.425 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/12' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/39' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/10' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/34' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/38' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/11' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/16' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/32' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/30' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/14' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/18' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/13' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/33' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/17' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/35' 2024-04-14T11:01:26.426 INFO:tasks.workunit.client.0.smithi084.stdout:removed './155/37' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './155' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/19' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/15' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/31' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/36' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/20' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/12' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/39' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/10' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/34' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/38' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/11' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/16' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/32' 2024-04-14T11:01:26.427 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/30' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/14' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/18' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/13' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/33' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/17' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/35' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './156/37' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './156' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/19' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/15' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/31' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/36' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/20' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/12' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/39' 2024-04-14T11:01:26.428 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/10' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/34' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/38' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/11' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/16' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/32' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/30' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/14' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/18' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/13' 2024-04-14T11:01:26.429 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/33' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/17' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/35' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './157/37' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './157' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/19' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/15' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/31' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/36' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/20' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/12' 2024-04-14T11:01:27.017 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/39' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/10' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/34' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/38' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/11' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/16' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/32' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/30' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/14' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/18' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/13' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/33' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/17' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/35' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed './158/37' 2024-04-14T11:01:27.018 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './158' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/19' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/15' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/31' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/36' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/20' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/12' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/39' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/10' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/34' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/38' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/11' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/16' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/32' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/30' 2024-04-14T11:01:27.019 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/14' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/18' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/13' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/33' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/17' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/35' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './159/37' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './159' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/19' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/15' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/31' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/36' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/20' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/12' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/39' 2024-04-14T11:01:27.020 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/10' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/34' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/38' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/11' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/16' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/32' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/30' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/14' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/18' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/13' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/33' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/17' 2024-04-14T11:01:27.021 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/35' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './160/37' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './160' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/19' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/15' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/31' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/36' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/20' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/12' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/39' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/10' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/34' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/38' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/11' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/16' 2024-04-14T11:01:27.022 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/32' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/30' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/14' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/18' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/13' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/33' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/17' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/35' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './161/37' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './161' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/19' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/15' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/31' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/36' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/20' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/12' 2024-04-14T11:01:27.023 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/39' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/10' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/34' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/38' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/11' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/16' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/32' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/30' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/14' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/18' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/13' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/33' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/17' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/35' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './162/37' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './162' 2024-04-14T11:01:27.024 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/19' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/15' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/31' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/36' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/20' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/12' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/39' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/10' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/34' 2024-04-14T11:01:27.025 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/38' 2024-04-14T11:01:27.026 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/11' 2024-04-14T11:01:27.026 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/16' 2024-04-14T11:01:27.026 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/32' 2024-04-14T11:01:27.026 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/30' 2024-04-14T11:01:27.026 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/14' 2024-04-14T11:01:27.026 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/18' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/13' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/33' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/17' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/35' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './163/37' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './163' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/19' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/15' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/31' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/36' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/20' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/12' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/39' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/10' 2024-04-14T11:01:27.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/34' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/38' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/11' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/16' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/32' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/30' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/14' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/18' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/13' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/33' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/17' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/35' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './164/37' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './164' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/19' 2024-04-14T11:01:27.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/15' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/31' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/36' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/20' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/12' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/39' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/10' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/34' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/38' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/11' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/16' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/32' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/30' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/14' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/18' 2024-04-14T11:01:27.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/13' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/33' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/17' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/35' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './165/37' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './165' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/19' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/15' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/31' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/36' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/20' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/12' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/39' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/10' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/34' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/38' 2024-04-14T11:01:27.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/11' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/16' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/32' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/30' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/14' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/18' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/13' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/33' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/17' 2024-04-14T11:01:27.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/35' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './166/37' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './166' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/19' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/15' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/31' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/36' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/20' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/12' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/39' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/10' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/34' 2024-04-14T11:01:27.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/38' 2024-04-14T11:01:27.580 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/11' 2024-04-14T11:01:27.580 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/16' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/32' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/30' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/14' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/18' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/13' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/33' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/17' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/35' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './167/37' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './167' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/19' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/15' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/31' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/36' 2024-04-14T11:01:27.581 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/20' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/12' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/39' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/10' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/34' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/38' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/11' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/16' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/32' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/30' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/14' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/18' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/13' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/33' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/17' 2024-04-14T11:01:27.582 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/35' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './168/37' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './168' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/19' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/15' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/31' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/36' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/20' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/12' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/39' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/10' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/34' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/38' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/11' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/16' 2024-04-14T11:01:27.583 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/32' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/30' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/14' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/18' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/13' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/33' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/17' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/35' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './169/37' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './169' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/19' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/15' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/31' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/36' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/20' 2024-04-14T11:01:27.584 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/12' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/39' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/10' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/34' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/38' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/11' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/16' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/32' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/30' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/14' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/18' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/13' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/33' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/17' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/35' 2024-04-14T11:01:27.585 INFO:tasks.workunit.client.0.smithi084.stdout:removed './170/37' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './170' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/19' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/15' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/31' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/36' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/20' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/12' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/39' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/10' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/34' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/38' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/11' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/16' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/32' 2024-04-14T11:01:27.586 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/30' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/14' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/18' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/13' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/33' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/17' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/35' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './171/37' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './171' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/19' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/15' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/31' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/36' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/20' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/12' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/39' 2024-04-14T11:01:27.587 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/10' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/34' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/38' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/11' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/16' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/32' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/30' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/14' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/18' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/13' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/33' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/17' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/35' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './172/37' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './172' 2024-04-14T11:01:27.588 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/19' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/15' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/31' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/36' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/20' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/12' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/39' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/10' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/34' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/38' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/11' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/16' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/32' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/30' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/14' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/18' 2024-04-14T11:01:27.589 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/13' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/33' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/17' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/35' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './173/37' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './173' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/19' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/15' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/31' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/36' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/20' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/12' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/39' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/10' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/34' 2024-04-14T11:01:27.590 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/38' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/11' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/16' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/32' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/30' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/14' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/18' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/13' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/33' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/17' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/35' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './174/37' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './174' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/19' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/15' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/31' 2024-04-14T11:01:27.591 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/36' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/20' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/12' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/39' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/10' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/34' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/38' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/11' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/16' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/32' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/30' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/14' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/18' 2024-04-14T11:01:27.592 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/13' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/33' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/17' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/35' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './175/37' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './175' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/19' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/15' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/31' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/36' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/20' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/12' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/39' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/10' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/34' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/38' 2024-04-14T11:01:27.593 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/11' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/16' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/32' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/30' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/14' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/18' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/13' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/33' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/17' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/35' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './176/37' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './176' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/19' 2024-04-14T11:01:27.594 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/15' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/31' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/36' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/20' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/12' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/39' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/10' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/34' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/38' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/11' 2024-04-14T11:01:28.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/16' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/32' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/30' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/14' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/18' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/13' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/33' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/17' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/35' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './177/37' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './177' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/19' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/15' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/31' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/36' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/20' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/12' 2024-04-14T11:01:28.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/39' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/10' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/34' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/38' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/11' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/16' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/32' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/30' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/14' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/18' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/13' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/33' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/17' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/35' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './178/37' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './178' 2024-04-14T11:01:28.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/19' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/15' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/31' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/36' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/20' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/12' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/39' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/10' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/34' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/38' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/11' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/16' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/32' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/30' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/14' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/18' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/13' 2024-04-14T11:01:28.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/33' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/17' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/35' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './179/37' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './179' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/19' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/15' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/31' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/36' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/20' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/12' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/39' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/10' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/34' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/38' 2024-04-14T11:01:28.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/11' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/16' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/32' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/30' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/14' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/18' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/13' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/33' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/17' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/35' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './180/37' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './180' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/19' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/15' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/31' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/36' 2024-04-14T11:01:28.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/20' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/12' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/39' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/10' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/34' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/38' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/11' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/16' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/32' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/30' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/14' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/18' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/13' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/33' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/17' 2024-04-14T11:01:28.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/35' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './181/37' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './181' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/19' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/15' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/31' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/36' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/20' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/12' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/39' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/10' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/34' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/38' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/11' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/16' 2024-04-14T11:01:28.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/32' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/30' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/14' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/18' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/13' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/33' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/17' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/35' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './182/37' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './182' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/19' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/15' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/31' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/36' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/20' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/12' 2024-04-14T11:01:28.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/39' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/10' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/34' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/38' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/11' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/16' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/32' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/30' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/14' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/18' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/13' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/33' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/17' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/35' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './183/37' 2024-04-14T11:01:28.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './183' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/19' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/15' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/31' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/36' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/20' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/12' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/39' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/10' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/34' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/38' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/11' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/16' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/32' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/30' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/14' 2024-04-14T11:01:28.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/18' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/13' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/33' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/17' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/35' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './184/37' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './184' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/19' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/15' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/31' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/36' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/20' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/12' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/39' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/10' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/34' 2024-04-14T11:01:28.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/38' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/11' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/16' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/32' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/30' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/14' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/18' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/13' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/33' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/17' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/35' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './185/37' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './185' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/19' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/15' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/31' 2024-04-14T11:01:28.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/36' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/20' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/12' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/39' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/10' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/34' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/38' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/11' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/16' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/32' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/30' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/14' 2024-04-14T11:01:28.127 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/18' 2024-04-14T11:01:28.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/13' 2024-04-14T11:01:28.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/33' 2024-04-14T11:01:28.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/17' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/35' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './186/37' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './186' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/19' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/15' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/31' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/36' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/20' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/12' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/39' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/10' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/34' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/38' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/11' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/16' 2024-04-14T11:01:28.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/32' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/30' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/14' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/18' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/13' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/33' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/17' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/35' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './187/37' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './187' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/19' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/15' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/31' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/36' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/20' 2024-04-14T11:01:28.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/12' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/39' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/10' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/34' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/38' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/11' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/16' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/32' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/30' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/14' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/18' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/13' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/33' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/17' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/35' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './188/37' 2024-04-14T11:01:28.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './188' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/19' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/15' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/31' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/36' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/20' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/12' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/39' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/10' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/34' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/38' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/11' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/16' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/32' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/30' 2024-04-14T11:01:28.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/14' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/18' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/13' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/33' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/17' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/35' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './189/37' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './189' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/19' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/15' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/31' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/36' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/20' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/12' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/39' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/10' 2024-04-14T11:01:28.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/34' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/38' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/11' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/16' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/32' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/30' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/14' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/18' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/13' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/33' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/17' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/35' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './190/37' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './190' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/19' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/15' 2024-04-14T11:01:28.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/31' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/36' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/20' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/12' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/39' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/10' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/34' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/38' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/11' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/16' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/32' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/30' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/14' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/18' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/13' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/33' 2024-04-14T11:01:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/17' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/35' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './191/37' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './191' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/19' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/15' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/31' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/36' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/20' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/12' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/39' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/10' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/34' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/38' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/11' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/16' 2024-04-14T11:01:28.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/32' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/30' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/14' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/18' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/13' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/33' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/17' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/35' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './192/37' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './192' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/19' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/15' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/31' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/36' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/20' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/12' 2024-04-14T11:01:28.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/39' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/10' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/34' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/38' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/11' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/16' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/32' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/30' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/14' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/18' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/13' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/33' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/17' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/35' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed './193/37' 2024-04-14T11:01:28.716 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './193' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/19' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/15' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/31' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/36' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/20' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/12' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/39' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/10' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/34' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/38' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/11' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/16' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/32' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/30' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/14' 2024-04-14T11:01:28.717 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/18' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/13' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/33' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/17' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/35' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './194/37' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './194' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/19' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/15' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/31' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/36' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/20' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/12' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/39' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/10' 2024-04-14T11:01:28.718 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/34' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/38' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/11' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/16' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/32' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/30' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/14' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/18' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/13' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/33' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/17' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/35' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './195/37' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './195' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/19' 2024-04-14T11:01:28.719 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/15' 2024-04-14T11:01:28.720 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/31' 2024-04-14T11:01:28.720 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/36' 2024-04-14T11:01:28.720 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/20' 2024-04-14T11:01:28.720 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/12' 2024-04-14T11:01:28.720 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/39' 2024-04-14T11:01:28.720 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/10' 2024-04-14T11:01:29.237 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/34' 2024-04-14T11:01:29.237 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/38' 2024-04-14T11:01:29.237 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/11' 2024-04-14T11:01:29.237 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/16' 2024-04-14T11:01:29.237 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/32' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/30' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/14' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/18' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/13' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/33' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/17' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/35' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './196/37' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './196' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/19' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/15' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/31' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/36' 2024-04-14T11:01:29.238 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/20' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/12' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/39' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/10' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/34' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/38' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/11' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/16' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/32' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/30' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/14' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/18' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/13' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/33' 2024-04-14T11:01:29.239 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/17' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/35' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './197/37' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './197' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/19' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/15' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/31' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/36' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/20' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/12' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/39' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/10' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/34' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/38' 2024-04-14T11:01:29.240 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/11' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/16' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/32' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/30' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/14' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/18' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/13' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/33' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/17' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/35' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './198/37' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './198' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/19' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/15' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/31' 2024-04-14T11:01:29.241 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/36' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/20' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/12' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/39' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/10' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/34' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/38' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/11' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/16' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/32' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/30' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/14' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/18' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/13' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/33' 2024-04-14T11:01:29.242 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/17' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/35' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './199/37' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './199' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/21' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/27' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/31' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/36' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/20' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/39' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/34' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/38' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/28' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/24' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/29' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/32' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/22' 2024-04-14T11:01:29.243 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/25' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/30' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/33' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/23' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/35' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/26' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './200/37' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './200' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/21' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/27' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/31' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/36' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/20' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/39' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/34' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/38' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/28' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/24' 2024-04-14T11:01:29.244 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/29' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/32' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/22' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/25' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/30' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/33' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/23' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/35' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/26' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './201/37' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './201' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/21' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/27' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/31' 2024-04-14T11:01:29.245 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/36' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/20' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/39' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/34' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/38' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/28' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/24' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/29' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/32' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/22' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/25' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/30' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/33' 2024-04-14T11:01:29.246 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/23' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/35' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/26' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './202/37' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './202' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/21' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/27' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/31' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/36' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/20' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/39' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/34' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/38' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/28' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/24' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/29' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/32' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/22' 2024-04-14T11:01:29.247 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/25' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/30' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/33' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/23' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/35' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/26' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './203/37' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './203' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/21' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/27' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/31' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/36' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/20' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/39' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/34' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/38' 2024-04-14T11:01:29.248 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/28' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/24' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/29' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/32' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/22' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/25' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/30' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/33' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/23' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/35' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/26' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './204/37' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './204' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/21' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/27' 2024-04-14T11:01:29.249 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/31' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/36' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/20' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/39' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/34' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/38' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/28' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/24' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/29' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/32' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/22' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/25' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/30' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/33' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/23' 2024-04-14T11:01:29.250 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/35' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/26' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './205/37' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './205' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/21' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/27' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/31' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/36' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/20' 2024-04-14T11:01:29.251 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/39' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/34' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/38' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/28' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/24' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/29' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/32' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/22' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/25' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/30' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/33' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/23' 2024-04-14T11:01:29.785 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/35' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/26' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './206/37' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './206' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/21' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/27' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/31' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/36' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/20' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/39' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/34' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/38' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/28' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/24' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/29' 2024-04-14T11:01:29.786 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/32' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/22' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/25' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/30' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/33' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/23' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/35' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/26' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './207/37' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './207' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/21' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/27' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/31' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/36' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/20' 2024-04-14T11:01:29.787 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/39' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/34' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/38' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/28' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/24' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/29' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/32' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/22' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/25' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/30' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/33' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/23' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/35' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/26' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed './208/37' 2024-04-14T11:01:29.788 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './208' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/21' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/27' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/31' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/36' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/20' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/39' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/34' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/38' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/28' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/24' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/29' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/32' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/22' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/25' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/30' 2024-04-14T11:01:29.789 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/33' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/23' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/35' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/26' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './209/37' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './209' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/21' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/27' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/31' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/36' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/20' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/39' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/34' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/38' 2024-04-14T11:01:29.790 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/28' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/24' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/29' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/32' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/22' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/25' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/30' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/33' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/23' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/35' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/26' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './210/37' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './210' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/21' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/27' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/31' 2024-04-14T11:01:29.791 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/36' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/20' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/39' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/34' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/38' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/28' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/24' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/29' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/32' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/22' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/25' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/30' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/33' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/23' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/35' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/26' 2024-04-14T11:01:29.792 INFO:tasks.workunit.client.0.smithi084.stdout:removed './211/37' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './211' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/21' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/27' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/31' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/36' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/20' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/39' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/34' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/38' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/28' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/24' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/29' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/32' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/22' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/25' 2024-04-14T11:01:29.793 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/30' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/33' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/23' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/35' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/26' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './212/37' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './212' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/21' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/27' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/31' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/36' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/20' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/39' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/34' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/38' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/28' 2024-04-14T11:01:29.794 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/24' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/29' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/32' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/22' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/25' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/30' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/33' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/23' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/35' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/26' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './213/37' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './213' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/21' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/27' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/31' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/36' 2024-04-14T11:01:29.795 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/20' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/39' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/34' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/38' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/28' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/24' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/29' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/32' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/22' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/25' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/30' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/33' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/23' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/35' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/26' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed './214/37' 2024-04-14T11:01:29.796 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './214' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/21' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/27' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/31' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/36' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/20' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/39' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/34' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/38' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/28' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/24' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/29' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/32' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/22' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/25' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/30' 2024-04-14T11:01:29.797 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/33' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/23' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/35' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/26' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './215/37' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './215' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/21' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/27' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/31' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/36' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/20' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/39' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/34' 2024-04-14T11:01:29.798 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/38' 2024-04-14T11:01:30.290 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/28' 2024-04-14T11:01:30.290 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/24' 2024-04-14T11:01:30.290 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/29' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/32' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/22' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/25' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/30' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/33' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/23' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/35' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/26' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './216/37' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './216' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/21' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/27' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/31' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/36' 2024-04-14T11:01:30.291 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/20' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/39' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/34' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/38' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/28' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/24' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/29' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/32' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/22' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/25' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/30' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/33' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/23' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/35' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/26' 2024-04-14T11:01:30.292 INFO:tasks.workunit.client.0.smithi084.stdout:removed './217/37' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './217' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/21' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/27' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/31' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/36' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/20' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/39' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/34' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/38' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/28' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/24' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/29' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/32' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/22' 2024-04-14T11:01:30.293 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/25' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/30' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/33' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/23' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/35' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/26' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './218/37' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './218' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/21' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/27' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/31' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/36' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/20' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/39' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/34' 2024-04-14T11:01:30.294 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/38' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/28' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/24' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/29' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/32' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/22' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/25' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/30' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/33' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/23' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/35' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/26' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './219/37' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './219' 2024-04-14T11:01:30.295 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/21' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/27' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/31' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/36' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/20' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/39' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/34' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/38' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/28' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/24' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/29' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/32' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/22' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/25' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/30' 2024-04-14T11:01:30.296 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/33' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/23' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/35' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/26' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './220/37' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './220' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/21' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/27' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/31' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/36' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/20' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/39' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/34' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/38' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/28' 2024-04-14T11:01:30.297 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/24' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/29' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/32' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/22' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/25' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/30' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/33' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/23' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/35' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/26' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './221/37' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './221' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/21' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/27' 2024-04-14T11:01:30.298 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/31' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/36' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/20' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/39' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/34' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/38' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/28' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/24' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/29' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/32' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/22' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/25' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/30' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/33' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/23' 2024-04-14T11:01:30.299 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/35' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/26' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './222/37' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './222' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/21' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/27' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/31' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/36' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/20' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/39' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/34' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/38' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/28' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/24' 2024-04-14T11:01:30.300 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/29' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/32' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/22' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/25' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/30' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/33' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/23' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/35' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/26' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './223/37' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './223' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/21' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/27' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/31' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/36' 2024-04-14T11:01:30.301 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/20' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/39' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/34' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/38' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/28' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/24' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/29' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/32' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/22' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/25' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/30' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/33' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/23' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/35' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/26' 2024-04-14T11:01:30.302 INFO:tasks.workunit.client.0.smithi084.stdout:removed './224/37' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './224' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/21' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/27' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/31' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/36' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/20' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/39' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/34' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/38' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/28' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/24' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/29' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/32' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/22' 2024-04-14T11:01:30.303 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/25' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/30' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/33' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/23' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/35' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/26' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './225/37' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './225' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/21' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/27' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/31' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/36' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/20' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/39' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/34' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/38' 2024-04-14T11:01:30.304 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/28' 2024-04-14T11:01:30.305 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/24' 2024-04-14T11:01:30.889 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/29' 2024-04-14T11:01:30.889 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/32' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/22' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/25' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/30' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/33' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/23' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/35' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/26' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './226/37' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './226' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/21' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/27' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/31' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/36' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/20' 2024-04-14T11:01:30.890 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/39' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/34' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/38' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/28' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/24' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/29' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/32' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/22' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/25' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/30' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/33' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/23' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/35' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/26' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './227/37' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './227' 2024-04-14T11:01:30.891 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/21' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/27' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/31' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/36' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/20' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/39' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/34' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/38' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/28' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/24' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/29' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/32' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/22' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/25' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/30' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/33' 2024-04-14T11:01:30.892 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/23' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/35' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/26' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './228/37' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './228' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/21' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/27' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/31' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/36' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/20' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/39' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/34' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/38' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/28' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/24' 2024-04-14T11:01:30.893 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/29' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/32' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/22' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/25' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/30' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/33' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/23' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/35' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/26' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './229/37' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './229' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/21' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/27' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/31' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/36' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/20' 2024-04-14T11:01:30.894 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/39' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/34' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/38' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/28' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/24' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/29' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/32' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/22' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/25' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/30' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/33' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/23' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/35' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/26' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed './230/37' 2024-04-14T11:01:30.895 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './230' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/21' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/27' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/31' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/36' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/20' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/39' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/34' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/38' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/28' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/24' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/29' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/32' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/22' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/25' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/30' 2024-04-14T11:01:30.896 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/33' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/23' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/35' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/26' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './231/37' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './231' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/21' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/27' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/31' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/36' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/20' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/39' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/34' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/38' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/28' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/24' 2024-04-14T11:01:30.897 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/29' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/32' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/22' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/25' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/30' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/33' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/23' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/35' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/26' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './232/37' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './232' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/21' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/27' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/31' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/36' 2024-04-14T11:01:30.898 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/20' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/39' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/34' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/38' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/28' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/24' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/29' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/32' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/22' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/25' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/30' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/33' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/23' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/35' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/26' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed './233/37' 2024-04-14T11:01:30.899 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './233' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/21' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/27' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/31' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/36' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/20' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/39' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/34' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/38' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/28' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/24' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/29' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/32' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/22' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/25' 2024-04-14T11:01:30.900 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/30' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/33' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/23' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/35' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/26' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './234/37' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './234' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/21' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/27' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/31' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/36' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/20' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/39' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/34' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/38' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/28' 2024-04-14T11:01:30.901 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/24' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/29' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/32' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/22' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/25' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/30' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/33' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/23' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/35' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/26' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './235/37' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './235' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/21' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/27' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/31' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/36' 2024-04-14T11:01:30.902 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/20' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/39' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/34' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/38' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/28' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/24' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/29' 2024-04-14T11:01:30.903 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/32' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/22' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/25' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/30' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/33' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/23' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/35' 2024-04-14T11:01:31.384 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/26' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './236/37' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './236' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/21' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/27' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/31' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/36' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/20' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/39' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/34' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/38' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/28' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/24' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/29' 2024-04-14T11:01:31.385 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/32' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/22' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/25' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/30' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/33' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/23' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/35' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/26' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './237/37' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './237' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/21' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/27' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/31' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/36' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/20' 2024-04-14T11:01:31.386 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/39' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/34' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/38' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/28' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/24' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/29' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/32' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/22' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/25' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/30' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/33' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/23' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/35' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/26' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed './238/37' 2024-04-14T11:01:31.387 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './238' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/21' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/27' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/31' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/36' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/20' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/39' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/34' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/38' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/28' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/24' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/29' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/32' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/22' 2024-04-14T11:01:31.388 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/25' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/30' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/33' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/23' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/35' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/26' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './239/37' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './239' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/21' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/27' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/31' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/36' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/20' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/39' 2024-04-14T11:01:31.389 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/34' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/38' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/28' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/24' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/29' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/32' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/22' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/25' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/30' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/33' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/23' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/35' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/26' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './240/37' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './240' 2024-04-14T11:01:31.390 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/21' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/27' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/31' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/36' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/20' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/39' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/34' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/38' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/28' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/24' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/29' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/32' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/22' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/25' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/30' 2024-04-14T11:01:31.391 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/33' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/23' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/35' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/26' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './241/37' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './241' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/21' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/27' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/31' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/36' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/20' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/39' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/34' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/38' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/28' 2024-04-14T11:01:31.392 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/24' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/29' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/32' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/22' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/25' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/30' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/33' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/23' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/35' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/26' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './242/37' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './242' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/21' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/27' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/31' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/36' 2024-04-14T11:01:31.393 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/20' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/39' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/34' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/38' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/28' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/24' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/29' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/32' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/22' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/25' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/30' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/33' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/23' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/35' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/26' 2024-04-14T11:01:31.394 INFO:tasks.workunit.client.0.smithi084.stdout:removed './243/37' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './243' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/21' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/27' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/31' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/36' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/20' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/39' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/34' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/38' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/28' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/24' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/29' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/32' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/22' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/25' 2024-04-14T11:01:31.395 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/30' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/33' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/23' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/35' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/26' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './244/37' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './244' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/21' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/27' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/31' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/36' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/20' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/39' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/34' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/38' 2024-04-14T11:01:31.396 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/28' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/24' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/29' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/32' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/22' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/25' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/30' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/33' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/23' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/35' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/26' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './245/37' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './245' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/21' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/27' 2024-04-14T11:01:31.397 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/31' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/36' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/20' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/39' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/34' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/38' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/28' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/24' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/29' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/32' 2024-04-14T11:01:31.398 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/22' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/25' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/30' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/33' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/23' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/35' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/26' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './246/37' 2024-04-14T11:01:31.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './246' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/21' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/27' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/31' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/36' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/20' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/39' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/34' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/38' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/28' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/24' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/29' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/32' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/22' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/25' 2024-04-14T11:01:31.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/30' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/33' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/23' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/35' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/26' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './247/37' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './247' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/21' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/27' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/31' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/36' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/20' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/39' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/34' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/38' 2024-04-14T11:01:31.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/28' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/24' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/29' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/32' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/22' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/25' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/30' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/33' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/23' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/35' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/26' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './248/37' 2024-04-14T11:01:31.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './248' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/21' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/27' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/31' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/36' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/20' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/39' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/34' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/38' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/28' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/24' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/29' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/32' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/22' 2024-04-14T11:01:31.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/25' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/30' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/33' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/23' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/35' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/26' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './249/37' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './249' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/21' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/27' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/31' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/36' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/20' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/39' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/34' 2024-04-14T11:01:31.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/38' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/28' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/24' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/29' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/32' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/22' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/25' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/30' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/33' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/23' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/35' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/26' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './250/37' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './250' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/21' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/27' 2024-04-14T11:01:31.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/31' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/36' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/20' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/39' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/34' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/38' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/28' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/24' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/29' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/32' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/22' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/25' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/30' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/33' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/23' 2024-04-14T11:01:31.957 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/35' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/26' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './251/37' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './251' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/21' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/27' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/31' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/36' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/20' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/39' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/34' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/38' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/28' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/24' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/29' 2024-04-14T11:01:31.958 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/32' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/22' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/25' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/30' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/33' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/23' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/35' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/26' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './252/37' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './252' 2024-04-14T11:01:31.959 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/21' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/27' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/31' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/36' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/20' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/39' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/34' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/38' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/28' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/24' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/29' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/32' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/22' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/25' 2024-04-14T11:01:31.960 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/30' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/33' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/23' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/35' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/26' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './253/37' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './253' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/21' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/27' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/31' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/36' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/20' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/39' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/34' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/38' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/28' 2024-04-14T11:01:31.961 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/24' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/29' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/32' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/22' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/25' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/30' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/33' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/23' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/35' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/26' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './254/37' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './254' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/21' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/27' 2024-04-14T11:01:31.962 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/31' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/36' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/20' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/39' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/34' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/38' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/28' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/24' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/29' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/32' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/22' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/25' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/30' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/33' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/23' 2024-04-14T11:01:31.963 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/35' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/26' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './255/37' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './255' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/21' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/27' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/31' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/36' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/20' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/39' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/34' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/38' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/28' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/24' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/29' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/32' 2024-04-14T11:01:31.964 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/22' 2024-04-14T11:01:31.965 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/25' 2024-04-14T11:01:31.965 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/30' 2024-04-14T11:01:32.461 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/33' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/23' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/35' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/26' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './256/37' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './256' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/21' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/27' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/31' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/36' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/20' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/39' 2024-04-14T11:01:32.462 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/34' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/38' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/28' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/24' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/29' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/32' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/22' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/25' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/30' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/33' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/23' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/35' 2024-04-14T11:01:32.463 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/26' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './257/37' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './257' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/21' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/27' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/31' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/36' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/20' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/39' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/34' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/38' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/28' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/24' 2024-04-14T11:01:32.464 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/29' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/32' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/22' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/25' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/30' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/33' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/23' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/35' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/26' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './258/37' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './258' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/21' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/27' 2024-04-14T11:01:32.465 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/31' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/36' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/20' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/39' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/34' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/38' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/28' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/24' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/29' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/32' 2024-04-14T11:01:32.466 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/22' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/25' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/30' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/33' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/23' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/35' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/26' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './259/37' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './259' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/21' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/27' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/31' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/36' 2024-04-14T11:01:32.467 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/20' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/39' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/34' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/38' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/28' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/24' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/29' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/32' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/22' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/25' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/30' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/33' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/23' 2024-04-14T11:01:32.468 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/35' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/26' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './260/37' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './260' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/21' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/27' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/31' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/36' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/20' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/39' 2024-04-14T11:01:32.469 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/34' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/38' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/28' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/24' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/29' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/32' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/22' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/25' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/30' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/33' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/23' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/35' 2024-04-14T11:01:32.470 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/26' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './261/37' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './261' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/21' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/27' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/31' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/36' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/20' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/39' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/34' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/38' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/28' 2024-04-14T11:01:32.471 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/24' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/29' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/32' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/22' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/25' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/30' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/33' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/23' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/35' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/26' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './262/37' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './262' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/21' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/27' 2024-04-14T11:01:32.472 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/31' 2024-04-14T11:01:32.473 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/36' 2024-04-14T11:01:32.473 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/20' 2024-04-14T11:01:32.473 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/39' 2024-04-14T11:01:32.473 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/34' 2024-04-14T11:01:32.473 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/38' 2024-04-14T11:01:32.473 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/28' 2024-04-14T11:01:32.474 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/24' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/29' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/32' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/22' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/25' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/30' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/33' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/23' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/35' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/26' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './263/37' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './263' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/21' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/27' 2024-04-14T11:01:32.475 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/31' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/36' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/20' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/39' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/34' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/38' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/28' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/24' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/29' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/32' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/22' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/25' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/30' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/33' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/23' 2024-04-14T11:01:32.476 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/35' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/26' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './264/37' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './264' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/21' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/27' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/31' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/36' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/20' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/39' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/34' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/38' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/28' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/24' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/29' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/32' 2024-04-14T11:01:32.477 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/22' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/25' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/30' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/33' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/23' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/35' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/26' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './265/37' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './265' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/21' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/27' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/31' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/36' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/20' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/39' 2024-04-14T11:01:32.478 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/34' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/38' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/28' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/24' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/29' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/32' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/22' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/25' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/30' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/33' 2024-04-14T11:01:32.479 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/23' 2024-04-14T11:01:33.111 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/35' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/26' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './266/37' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './266' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/21' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/27' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/31' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/36' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/20' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/39' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/34' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/38' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/28' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/24' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/29' 2024-04-14T11:01:33.112 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/32' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/22' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/25' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/30' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/33' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/23' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/35' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/26' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './267/37' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './267' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/21' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/27' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/31' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/36' 2024-04-14T11:01:33.113 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/20' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/39' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/34' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/38' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/28' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/24' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/29' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/32' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/22' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/25' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/30' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/33' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/23' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/35' 2024-04-14T11:01:33.114 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/26' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './268/37' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './268' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/21' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/27' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/31' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/36' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/20' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/39' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/34' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/38' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/28' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/24' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/29' 2024-04-14T11:01:33.115 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/32' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/22' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/25' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/30' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/33' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/23' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/35' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/26' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './269/37' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './269' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/21' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/27' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/31' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/36' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/20' 2024-04-14T11:01:33.116 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/39' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/34' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/38' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/28' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/24' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/29' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/32' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/22' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/25' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/30' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/33' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/23' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/35' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/26' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './270/37' 2024-04-14T11:01:33.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './270' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/21' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/27' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/31' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/36' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/20' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/39' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/34' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/38' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/28' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/24' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/29' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/32' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/22' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/25' 2024-04-14T11:01:33.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/30' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/33' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/23' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/35' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/26' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './271/37' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './271' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/21' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/27' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/31' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/36' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/20' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/39' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/34' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/38' 2024-04-14T11:01:33.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/28' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/24' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/29' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/32' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/22' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/25' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/30' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/33' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/23' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/35' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/26' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './272/37' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './272' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/21' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/27' 2024-04-14T11:01:33.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/31' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/36' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/20' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/39' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/34' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/38' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/28' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/24' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/29' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/32' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/22' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/25' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/30' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/33' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/23' 2024-04-14T11:01:33.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/35' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/26' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './273/37' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './273' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/21' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/27' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/31' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/36' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/20' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/39' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/34' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/38' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/28' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/24' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/29' 2024-04-14T11:01:33.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/32' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/22' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/25' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/30' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/33' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/23' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/35' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/26' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './274/37' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './274' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/21' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/27' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/31' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/36' 2024-04-14T11:01:33.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/20' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/39' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/34' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/38' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/28' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/24' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/29' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/32' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/22' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/25' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/30' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/33' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/23' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/35' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/26' 2024-04-14T11:01:33.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './275/37' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './275' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/21' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/27' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/31' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/36' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/20' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/39' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/34' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/38' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/28' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/24' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/29' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/32' 2024-04-14T11:01:33.125 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/22' 2024-04-14T11:01:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/25' 2024-04-14T11:01:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/30' 2024-04-14T11:01:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/33' 2024-04-14T11:01:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/23' 2024-04-14T11:01:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/35' 2024-04-14T11:01:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/26' 2024-04-14T11:01:33.700 INFO:tasks.workunit.client.0.smithi084.stdout:removed './276/37' 2024-04-14T11:01:33.700 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './276' 2024-04-14T11:01:33.700 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/21' 2024-04-14T11:01:33.700 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/27' 2024-04-14T11:01:33.700 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/31' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/36' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/20' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/39' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/34' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/38' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/28' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/24' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/29' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/32' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/22' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/25' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/30' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/33' 2024-04-14T11:01:33.701 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/23' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/35' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/26' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './277/37' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './277' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/21' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/27' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/31' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/36' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/20' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/39' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/34' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/38' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/28' 2024-04-14T11:01:33.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/24' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/29' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/32' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/22' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/25' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/30' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/33' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/23' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/35' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/26' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './278/37' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './278' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/21' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/27' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/31' 2024-04-14T11:01:33.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/36' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/20' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/39' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/34' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/38' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/28' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/24' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/29' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/32' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/22' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/25' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/30' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/33' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/23' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/35' 2024-04-14T11:01:33.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/26' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './279/37' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './279' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/21' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/27' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/31' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/36' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/20' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/39' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/34' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/38' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/28' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/24' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/29' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/32' 2024-04-14T11:01:33.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/22' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/25' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/30' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/33' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/23' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/35' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/26' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './280/37' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './280' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/21' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/27' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/31' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/36' 2024-04-14T11:01:33.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/20' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/39' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/34' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/38' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/28' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/24' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/29' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/32' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/22' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/25' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/30' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/33' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/23' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/35' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/26' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './281/37' 2024-04-14T11:01:33.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './281' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/21' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/27' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/31' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/36' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/20' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/39' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/34' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/38' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/28' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/24' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/29' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/32' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/22' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/25' 2024-04-14T11:01:33.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/30' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/33' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/23' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/35' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/26' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './282/37' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './282' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/21' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/27' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/31' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/36' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/20' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/39' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/34' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/38' 2024-04-14T11:01:33.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/28' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/24' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/29' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/32' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/22' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/25' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/30' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/33' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/23' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/35' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/26' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './283/37' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './283' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/21' 2024-04-14T11:01:33.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/27' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/31' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/36' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/20' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/39' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/34' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/38' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/28' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/24' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/29' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/32' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/22' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/25' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/30' 2024-04-14T11:01:33.711 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/33' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/23' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/35' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/26' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './284/37' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './284' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/21' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/27' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/31' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/36' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/20' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/39' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/34' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/38' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/28' 2024-04-14T11:01:33.712 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/24' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/29' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/32' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/22' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/25' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/30' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/33' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/23' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/35' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/26' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './285/37' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './285' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/21' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/27' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/31' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/36' 2024-04-14T11:01:33.713 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/20' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/39' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/34' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/38' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/28' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/24' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/29' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/32' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/22' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/25' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/30' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/33' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/23' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/35' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/26' 2024-04-14T11:01:33.714 INFO:tasks.workunit.client.0.smithi084.stdout:removed './286/37' 2024-04-14T11:01:33.715 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './286' 2024-04-14T11:01:34.201 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/21' 2024-04-14T11:01:34.201 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/27' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/31' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/36' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/20' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/39' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/34' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/38' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/28' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/24' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/29' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/32' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/22' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/25' 2024-04-14T11:01:34.202 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/30' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/33' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/23' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/35' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/26' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './287/37' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './287' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/21' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/27' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/31' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/36' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/20' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/39' 2024-04-14T11:01:34.203 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/34' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/38' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/28' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/24' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/29' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/32' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/22' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/25' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/30' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/33' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/23' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/35' 2024-04-14T11:01:34.204 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/26' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './288/37' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './288' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/21' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/27' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/31' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/36' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/20' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/39' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/34' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/38' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/28' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/24' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/29' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/32' 2024-04-14T11:01:34.205 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/22' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/25' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/30' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/33' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/23' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/35' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/26' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './289/37' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './289' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/21' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/27' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/31' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/36' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/20' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/39' 2024-04-14T11:01:34.206 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/34' 2024-04-14T11:01:34.207 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/38' 2024-04-14T11:01:34.207 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/28' 2024-04-14T11:01:34.207 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/24' 2024-04-14T11:01:34.207 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/29' 2024-04-14T11:01:34.207 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/32' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/22' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/25' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/30' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/33' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/23' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/35' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/26' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './290/37' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './290' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/21' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/27' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/31' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/36' 2024-04-14T11:01:34.208 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/20' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/39' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/34' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/38' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/28' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/24' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/29' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/32' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/22' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/25' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/30' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/33' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/23' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/35' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/26' 2024-04-14T11:01:34.209 INFO:tasks.workunit.client.0.smithi084.stdout:removed './291/37' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './291' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/21' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/27' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/31' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/36' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/20' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/39' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/34' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/38' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/28' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/24' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/29' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/32' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/22' 2024-04-14T11:01:34.210 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/25' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/30' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/33' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/23' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/35' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/26' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed './292/37' 2024-04-14T11:01:34.211 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './292' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/21' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/27' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/31' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/36' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/20' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/39' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/34' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/38' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/28' 2024-04-14T11:01:34.212 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/24' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/29' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/32' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/22' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/25' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/30' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/33' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/23' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/35' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/26' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './293/37' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './293' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/21' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/27' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/31' 2024-04-14T11:01:34.213 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/36' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/20' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/39' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/34' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/38' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/28' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/24' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/29' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/32' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/22' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/25' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/30' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/33' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/23' 2024-04-14T11:01:34.214 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/35' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/26' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './294/37' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './294' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/21' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/27' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/31' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/36' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/20' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/39' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/34' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/38' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/28' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/24' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/29' 2024-04-14T11:01:34.215 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/32' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/22' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/25' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/30' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/33' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/23' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/35' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/26' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './295/37' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './295' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/21' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/27' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/31' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/36' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/20' 2024-04-14T11:01:34.216 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/39' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/34' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/38' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/28' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/24' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/29' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/32' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/22' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/25' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/30' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/33' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/23' 2024-04-14T11:01:34.217 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/35' 2024-04-14T11:01:34.218 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/26' 2024-04-14T11:01:34.218 INFO:tasks.workunit.client.0.smithi084.stdout:removed './296/37' 2024-04-14T11:01:34.218 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './296' 2024-04-14T11:01:34.218 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/21' 2024-04-14T11:01:34.218 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/27' 2024-04-14T11:01:34.375 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:01:34.378 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:01:34.679 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/31' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/36' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/20' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/39' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/34' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/38' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/28' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/24' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/29' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/32' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/22' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/25' 2024-04-14T11:01:34.680 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/30' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/33' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/23' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/35' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/26' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './297/37' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './297' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/21' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/27' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/31' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/36' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/20' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/39' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/34' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/38' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/28' 2024-04-14T11:01:34.681 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/24' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/29' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/32' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/22' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/25' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/30' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/33' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/23' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/35' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/26' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './298/37' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './298' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/21' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/27' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/31' 2024-04-14T11:01:34.682 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/36' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/20' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/39' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/34' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/38' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/28' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/24' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/29' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/32' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/22' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/25' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/30' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/33' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/23' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/35' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/26' 2024-04-14T11:01:34.683 INFO:tasks.workunit.client.0.smithi084.stdout:removed './299/37' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './299' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/19' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/15' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/20' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/12' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/10' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/11' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/16' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/14' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/18' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/13' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/166/17' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/166' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/19' 2024-04-14T11:01:34.684 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/15' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/20' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/12' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/10' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/11' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/16' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/14' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/18' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/13' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/147/17' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/147' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/19' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/15' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/20' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/12' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/10' 2024-04-14T11:01:34.685 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/11' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/16' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/14' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/18' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/13' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/151/17' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/151' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/19' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/15' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/20' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/12' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/10' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/11' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/16' 2024-04-14T11:01:34.686 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/14' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/18' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/13' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/170/17' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/170' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/19' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/15' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/20' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/12' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/10' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/11' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/16' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/14' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/18' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/13' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/167/17' 2024-04-14T11:01:34.687 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/167' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/19' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/15' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/20' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/12' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/10' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/11' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/16' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/14' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/18' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/13' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/140/17' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/140' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/19' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/15' 2024-04-14T11:01:34.688 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/20' 2024-04-14T11:01:34.689 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/12' 2024-04-14T11:01:34.689 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/10' 2024-04-14T11:01:34.949 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/11' 2024-04-14T11:01:34.949 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/16' 2024-04-14T11:01:34.949 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/14' 2024-04-14T11:01:34.949 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/18' 2024-04-14T11:01:34.949 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/13' 2024-04-14T11:01:34.949 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/142/17' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/142' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/19' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/15' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/20' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/12' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/10' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/11' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/16' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/14' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/18' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/13' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/150/17' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/150' 2024-04-14T11:01:34.950 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/19' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/15' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/20' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/12' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/10' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/11' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/16' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/14' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/18' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/13' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/105/17' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/105' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/19' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/15' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/20' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/12' 2024-04-14T11:01:34.951 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/10' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/11' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/16' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/14' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/18' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/13' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/149/17' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/149' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/19' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/15' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/20' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/12' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/10' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/11' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/16' 2024-04-14T11:01:34.952 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/14' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/18' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/13' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/109/17' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/109' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/19' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/15' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/20' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/12' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/10' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/11' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/16' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/14' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/18' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/13' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/158/17' 2024-04-14T11:01:34.953 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/158' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/19' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/15' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/20' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/12' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/10' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/11' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/16' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/14' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/18' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/13' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/106/17' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/106' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/19' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/15' 2024-04-14T11:01:34.954 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/20' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/12' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/10' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/11' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/16' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/14' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/18' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/13' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/189/17' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/189' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/19' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/15' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/20' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/12' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/10' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/11' 2024-04-14T11:01:34.955 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/16' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/14' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/18' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/13' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/133/17' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/133' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/19' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/15' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/20' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/12' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/10' 2024-04-14T11:01:34.956 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/11' 2024-04-14T11:01:35.222 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/16' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/14' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/18' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/13' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/173/17' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/173' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/19' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/15' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/20' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/12' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/10' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/11' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/16' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/14' 2024-04-14T11:01:35.223 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/18' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/13' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/174/17' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/174' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/19' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/15' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/20' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/12' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/10' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/11' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/16' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/14' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/18' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/13' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/155/17' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/155' 2024-04-14T11:01:35.224 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/19' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/15' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/20' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/12' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/10' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/11' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/16' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/14' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/18' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/13' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/114/17' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/114' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/19' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/15' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/20' 2024-04-14T11:01:35.225 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/12' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/10' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/11' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/16' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/14' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/18' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/13' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/159/17' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/159' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/19' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/15' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/20' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/12' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/10' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/11' 2024-04-14T11:01:35.226 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/16' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/14' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/18' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/13' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/187/17' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/187' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/19' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/15' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/20' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/12' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/10' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/11' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/16' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/14' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/18' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/13' 2024-04-14T11:01:35.227 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/185/17' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/185' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/19' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/15' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/20' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/12' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/10' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/11' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/16' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/14' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/18' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/13' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/120/17' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/120' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/19' 2024-04-14T11:01:35.228 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/15' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/20' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/12' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/10' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/11' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/16' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/14' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/18' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/13' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/110/17' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/110' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/19' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/15' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/20' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/12' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/10' 2024-04-14T11:01:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/11' 2024-04-14T11:01:35.230 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/16' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/14' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/18' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/13' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/137/17' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/137' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/19' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/15' 2024-04-14T11:01:35.498 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/20' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/12' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/10' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/11' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/16' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/14' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/18' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/13' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/198/17' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/198' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/19' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/15' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/20' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/12' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/10' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/11' 2024-04-14T11:01:35.499 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/16' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/14' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/18' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/13' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/136/17' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/136' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/19' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/15' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/20' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/12' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/10' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/11' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/16' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/14' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/18' 2024-04-14T11:01:35.500 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/13' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/125/17' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/125' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/19' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/15' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/20' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/12' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/10' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/11' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/16' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/14' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/18' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/13' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/194/17' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/194' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/19' 2024-04-14T11:01:35.501 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/15' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/20' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/12' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/10' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/11' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/16' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/14' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/18' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/13' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/119/17' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/119' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/19' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/15' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/20' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/12' 2024-04-14T11:01:35.502 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/10' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/11' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/16' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/14' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/18' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/13' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/157/17' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/157' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/19' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/15' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/20' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/12' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/10' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/11' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/16' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/14' 2024-04-14T11:01:35.503 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/18' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/13' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/172/17' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/172' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/19' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/15' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/20' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/12' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/10' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/11' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/16' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/14' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/18' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/13' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/186/17' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/186' 2024-04-14T11:01:35.504 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/19' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/15' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/20' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/12' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/10' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/11' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/16' 2024-04-14T11:01:35.505 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/14' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/18' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/13' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/190/17' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/190' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/19' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/15' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/20' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/12' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/10' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/11' 2024-04-14T11:01:35.834 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/16' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/14' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/18' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/13' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/104/17' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/104' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/19' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/15' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/20' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/12' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/10' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/11' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/16' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/14' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/18' 2024-04-14T11:01:35.835 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/13' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/164/17' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/164' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/19' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/15' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/20' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/12' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/10' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/11' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/16' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/14' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/18' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/13' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/112/17' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/112' 2024-04-14T11:01:35.836 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/19' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/15' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/20' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/12' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/10' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/11' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/16' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/14' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/18' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/13' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/100/17' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/100' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/19' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/15' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/20' 2024-04-14T11:01:35.837 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/12' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/10' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/11' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/16' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/14' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/18' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/13' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/134/17' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/134' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/19' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/15' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/20' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/12' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/10' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/11' 2024-04-14T11:01:35.838 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/16' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/14' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/18' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/13' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/115/17' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/115' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/19' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/15' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/20' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/12' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/10' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/11' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/16' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/14' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/18' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/13' 2024-04-14T11:01:35.839 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/116/17' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/116' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/19' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/15' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/20' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/12' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/10' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/11' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/16' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/14' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/18' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/13' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/195/17' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/195' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/19' 2024-04-14T11:01:35.840 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/15' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/20' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/12' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/10' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/11' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/16' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/14' 2024-04-14T11:01:35.841 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/18' 2024-04-14T11:01:36.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/13' 2024-04-14T11:01:36.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/138/17' 2024-04-14T11:01:36.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/138' 2024-04-14T11:01:36.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/19' 2024-04-14T11:01:36.117 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/15' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/20' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/12' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/10' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/11' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/16' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/14' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/18' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/13' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/135/17' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/135' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/19' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/15' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/20' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/12' 2024-04-14T11:01:36.118 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/10' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/11' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/16' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/14' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/18' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/13' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/117/17' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/117' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/19' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/15' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/20' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/12' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/10' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/11' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/16' 2024-04-14T11:01:36.119 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/14' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/18' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/13' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/143/17' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/143' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/19' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/15' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/20' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/12' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/10' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/11' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/16' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/14' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/18' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/13' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/180/17' 2024-04-14T11:01:36.120 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/180' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/19' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/15' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/20' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/12' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/10' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/11' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/16' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/14' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/18' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/13' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/126/17' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/126' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/19' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/15' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/20' 2024-04-14T11:01:36.121 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/12' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/10' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/11' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/16' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/14' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/18' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/13' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/161/17' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/161' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/19' 2024-04-14T11:01:36.122 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/15' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/20' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/12' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/10' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/11' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/16' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/14' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/18' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/13' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/176/17' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/176' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/19' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/15' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/20' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/12' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/10' 2024-04-14T11:01:36.123 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/11' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/16' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/14' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/18' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/13' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/111/17' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/111' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/19' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/15' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/20' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/12' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/10' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/11' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/16' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/14' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/18' 2024-04-14T11:01:36.124 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/13' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/191/17' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/191' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/19' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/15' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/20' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/12' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/10' 2024-04-14T11:01:36.403 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/11' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/16' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/14' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/18' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/13' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/184/17' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/184' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/19' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/15' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/20' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/12' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/10' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/11' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/16' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/14' 2024-04-14T11:01:36.404 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/18' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/13' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/192/17' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/192' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/19' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/15' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/20' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/12' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/10' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/11' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/16' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/14' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/18' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/13' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/103/17' 2024-04-14T11:01:36.405 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/103' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/19' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/15' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/20' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/12' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/10' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/11' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/16' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/14' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/18' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/13' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/128/17' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/128' 2024-04-14T11:01:36.406 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/19' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/15' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/20' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/12' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/10' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/11' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/16' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/14' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/18' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/13' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/144/17' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/144' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/19' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/15' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/20' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/12' 2024-04-14T11:01:36.407 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/10' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/11' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/16' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/14' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/18' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/13' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/146/17' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/146' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/19' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/15' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/20' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/12' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/10' 2024-04-14T11:01:36.408 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/11' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/16' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/14' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/18' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/13' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/141/17' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/141' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/19' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/15' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/20' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/12' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/10' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/11' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/16' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/14' 2024-04-14T11:01:36.409 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/18' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/13' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/182/17' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/182' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/19' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/15' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/20' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/12' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/10' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/11' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/16' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/14' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/18' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/13' 2024-04-14T11:01:36.410 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/107/17' 2024-04-14T11:01:36.736 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/107' 2024-04-14T11:01:36.736 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/19' 2024-04-14T11:01:36.736 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/15' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/20' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/12' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/10' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/11' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/16' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/14' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/18' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/13' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/178/17' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/178' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/19' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/15' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/20' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/12' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/10' 2024-04-14T11:01:36.737 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/11' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/16' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/14' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/18' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/13' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/156/17' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/156' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/19' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/15' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/20' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/12' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/10' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/11' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/16' 2024-04-14T11:01:36.738 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/14' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/18' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/13' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/131/17' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/131' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/19' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/15' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/20' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/12' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/10' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/11' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/16' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/14' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/18' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/13' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/123/17' 2024-04-14T11:01:36.739 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/123' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/19' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/15' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/20' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/12' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/10' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/11' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/16' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/14' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/18' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/13' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/160/17' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/160' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/19' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/15' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/20' 2024-04-14T11:01:36.740 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/12' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/10' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/11' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/16' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/14' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/18' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/13' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/165/17' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/165' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/19' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/15' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/20' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/12' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/10' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/11' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/16' 2024-04-14T11:01:36.741 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/14' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/18' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/13' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/101/17' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/101' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/19' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/15' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/20' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/12' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/10' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/11' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/16' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/14' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/18' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/13' 2024-04-14T11:01:36.742 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/148/17' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/148' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/19' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/15' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/20' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/12' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/10' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/11' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/16' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/14' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/18' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/13' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/168/17' 2024-04-14T11:01:36.743 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/168' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/19' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/15' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/20' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/12' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/10' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/11' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/16' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/14' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/18' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/13' 2024-04-14T11:01:37.027 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/179/17' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/179' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/19' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/15' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/20' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/12' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/10' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/11' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/16' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/14' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/18' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/13' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/132/17' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/132' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/19' 2024-04-14T11:01:37.028 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/15' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/20' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/12' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/10' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/11' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/16' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/14' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/18' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/13' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/199/17' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/199' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/19' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/15' 2024-04-14T11:01:37.029 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/20' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/12' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/10' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/11' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/16' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/14' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/18' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/13' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/163/17' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/163' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/19' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/15' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/20' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/12' 2024-04-14T11:01:37.030 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/10' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/11' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/16' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/14' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/18' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/13' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/153/17' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/153' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/19' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/15' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/20' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/12' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/10' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/11' 2024-04-14T11:01:37.031 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/16' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/14' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/18' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/13' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/122/17' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/122' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/19' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/15' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/20' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/12' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/10' 2024-04-14T11:01:37.032 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/11' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/16' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/14' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/18' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/13' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/162/17' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/162' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/19' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/15' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/20' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/12' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/10' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/11' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/16' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/14' 2024-04-14T11:01:37.033 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/18' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/13' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/197/17' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/197' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/19' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/15' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/20' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/12' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/10' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/11' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/16' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/14' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/18' 2024-04-14T11:01:37.034 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/13' 2024-04-14T11:01:37.035 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/113/17' 2024-04-14T11:01:37.035 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/113' 2024-04-14T11:01:37.035 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/19' 2024-04-14T11:01:37.331 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/15' 2024-04-14T11:01:37.331 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/20' 2024-04-14T11:01:37.331 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/12' 2024-04-14T11:01:37.331 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/10' 2024-04-14T11:01:37.331 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/11' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/16' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/14' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/18' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/13' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/152/17' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/152' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/19' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/15' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/20' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/12' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/10' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/11' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/16' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/14' 2024-04-14T11:01:37.332 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/18' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/13' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/121/17' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/121' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/19' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/15' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/20' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/12' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/10' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/11' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/16' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/14' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/18' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/13' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/118/17' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/118' 2024-04-14T11:01:37.333 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/19' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/15' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/20' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/12' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/10' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/11' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/16' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/14' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/18' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/13' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/196/17' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/196' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/19' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/15' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/20' 2024-04-14T11:01:37.334 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/12' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/10' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/11' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/16' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/14' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/18' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/13' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/124/17' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/124' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/19' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/15' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/20' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/12' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/10' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/11' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/16' 2024-04-14T11:01:37.335 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/14' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/18' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/13' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/188/17' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/188' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/19' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/15' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/20' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/12' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/10' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/11' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/16' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/14' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/18' 2024-04-14T11:01:37.336 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/13' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/145/17' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/145' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/19' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/15' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/20' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/12' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/10' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/11' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/16' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/14' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/18' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/13' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/130/17' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/130' 2024-04-14T11:01:37.337 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/19' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/15' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/20' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/12' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/10' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/11' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/16' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/14' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/18' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/13' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/193/17' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/193' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/19' 2024-04-14T11:01:37.338 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/15' 2024-04-14T11:01:37.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/20' 2024-04-14T11:01:37.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/12' 2024-04-14T11:01:37.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/10' 2024-04-14T11:01:37.702 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/11' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/16' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/14' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/18' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/13' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/175/17' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/175' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/19' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/15' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/20' 2024-04-14T11:01:37.703 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/12' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/10' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/11' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/16' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/14' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/18' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/13' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/181/17' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/181' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/19' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/15' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/20' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/12' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/10' 2024-04-14T11:01:37.704 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/11' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/16' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/14' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/18' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/13' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/127/17' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/127' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/19' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/15' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/20' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/12' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/10' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/11' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/16' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/14' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/18' 2024-04-14T11:01:37.705 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/13' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/108/17' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/108' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/19' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/15' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/20' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/12' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/10' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/11' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/16' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/14' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/18' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/13' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/183/17' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/183' 2024-04-14T11:01:37.706 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/19' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/15' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/20' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/12' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/10' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/11' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/16' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/14' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/18' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/13' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/177/17' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/177' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/19' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/15' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/20' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/12' 2024-04-14T11:01:37.707 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/10' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/11' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/16' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/14' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/18' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/13' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/169/17' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/169' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/19' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/15' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/20' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/12' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/10' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/11' 2024-04-14T11:01:37.708 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/16' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/14' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/18' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/13' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/154/17' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/154' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/19' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/15' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/20' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/12' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/10' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/11' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/16' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/14' 2024-04-14T11:01:37.709 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/18' 2024-04-14T11:01:37.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/13' 2024-04-14T11:01:37.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/171/17' 2024-04-14T11:01:37.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/171' 2024-04-14T11:01:37.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/19' 2024-04-14T11:01:37.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/15' 2024-04-14T11:01:37.710 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/20' 2024-04-14T11:01:37.817 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/12' 2024-04-14T11:01:37.817 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/10' 2024-04-14T11:01:37.817 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/11' 2024-04-14T11:01:37.817 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/16' 2024-04-14T11:01:37.817 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/14' 2024-04-14T11:01:37.817 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/18' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/13' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/139/17' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/139' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/19' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/15' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/20' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/12' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/10' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/11' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/16' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/14' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/18' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/13' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/102/17' 2024-04-14T11:01:37.818 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/102' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/19' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/15' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/20' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/12' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/10' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/11' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/16' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/14' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/18' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/13' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed './copyofsnap1/test1/129/17' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1/129' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1/test1' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:removed directory './copyofsnap1' 2024-04-14T11:01:37.819 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:01:37.820 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:01:37.820 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:01:37.858 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-04-14T11:01:37.858 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-04-14T11:01:37.922 INFO:tasks.workunit.client.0.smithi084.stderr:+ set -e 2024-04-14T11:01:37.922 INFO:tasks.workunit.client.0.smithi084.stderr:+ touch foo 2024-04-14T11:01:37.924 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod +x foo 2024-04-14T11:01:37.925 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/s 2024-04-14T11:01:37.937 INFO:tasks.workunit.client.0.smithi084.stderr:+ find .snap/s/foo -executable 2024-04-14T11:01:37.937 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep foo 2024-04-14T11:01:37.941 INFO:tasks.workunit.client.0.smithi084.stdout:.snap/s/foo 2024-04-14T11:01:37.941 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir .snap/s 2024-04-14T11:01:37.948 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm foo 2024-04-14T11:01:37.951 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:01:37.952 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:01:37.952 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:01:37.952 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:01:38.027 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-04-14T11:01:38.028 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-04-14T11:01:38.091 INFO:tasks.workunit.client.0.smithi084.stderr:+ set -e 2024-04-14T11:01:38.092 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir foo 2024-04-14T11:01:38.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo x 2024-04-14T11:01:38.095 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:39.773 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir foo/.snap/ss 2024-04-14T11:01:39.794 INFO:tasks.workunit.client.0.smithi084.stderr:+ ln foo/x foo/xx 2024-04-14T11:01:39.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat foo/.snap/ss/x 2024-04-14T11:01:39.804 INFO:tasks.workunit.client.0.smithi084.stdout:x 2024-04-14T11:01:39.805 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir foo/.snap/ss 2024-04-14T11:01:39.812 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo a 2024-04-14T11:01:39.814 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo b 2024-04-14T11:01:39.816 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir foo/.snap/s 2024-04-14T11:01:39.826 INFO:tasks.workunit.client.0.smithi084.stderr:++ cat foo/.snap/s/a 2024-04-14T11:01:39.833 INFO:tasks.workunit.client.0.smithi084.stderr:+ r=a 2024-04-14T11:01:39.833 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' -z a ']' 2024-04-14T11:01:39.833 INFO:tasks.workunit.client.0.smithi084.stderr:+ ln foo/b foo/b2 2024-04-14T11:01:39.836 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat foo/.snap/s/b 2024-04-14T11:01:39.842 INFO:tasks.workunit.client.0.smithi084.stdout:b 2024-04-14T11:01:39.842 INFO:tasks.workunit.client.0.smithi084.stdout:this used to hang: 2024-04-14T11:01:39.842 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'this used to hang:' 2024-04-14T11:01:39.842 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo more 2024-04-14T11:01:39.844 INFO:tasks.workunit.client.0.smithi084.stdout:oh, it didn't hang! good job. 2024-04-14T11:01:39.844 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2024-04-14T11:01:39.845 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat foo/b 2024-04-14T11:01:39.845 INFO:tasks.workunit.client.0.smithi084.stdout:b 2024-04-14T11:01:39.846 INFO:tasks.workunit.client.0.smithi084.stdout:more 2024-04-14T11:01:39.846 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir foo/.snap/s 2024-04-14T11:01:39.853 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm -r foo 2024-04-14T11:01:39.873 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:01:39.874 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:01:39.874 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:01:39.874 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:01:39.951 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-04-14T11:01:39.951 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-04-14T11:01:40.015 INFO:tasks.workunit.client.0.smithi084.stderr:+ set -e 2024-04-14T11:01:40.015 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.017 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/bar 2024-04-14T11:01:40.028 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/foo 2024-04-14T11:01:40.035 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/foo 2024-04-14T11:01:40.042 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:40.046 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/bar/a 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout: File: .snap/bar/a 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout:Device: 29h/41d Inode: 845524441765765 Links: 2 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1301/ ubuntu) 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout:Access: 2024-04-14 11:01:40.022172969 +0000 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout:Modify: 2024-04-14 11:01:40.022172969 +0000 2024-04-14T11:01:40.052 INFO:tasks.workunit.client.0.smithi084.stdout:Change: 2024-04-14 11:01:40.022172969 +0000 2024-04-14T11:01:40.053 INFO:tasks.workunit.client.0.smithi084.stdout: Birth: - 2024-04-14T11:01:40.053 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir .snap/bar 2024-04-14T11:01:40.059 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:01:40.060 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:01:40.060 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:01:40.060 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:01:40.134 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-04-14T11:01:40.135 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-04-14T11:01:40.200 INFO:tasks.workunit.client.0.smithi084.stderr:+ set -e 2024-04-14T11:01:40.200 INFO:tasks.workunit.client.0.smithi084.stderr:++ seq 1 20 2024-04-14T11:01:40.200 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:40.200 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.203 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:40.203 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:40.219 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:40.225 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:40.227 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:40.354 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:40.407 INFO:tasks.workunit.client.0.smithi084.stdout: 50353 ? 00:00:00 ps 2024-04-14T11:01:40.409 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:40.421 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:40.424 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:40.430 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:40.430 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.431 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:40.432 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:40.441 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:40.446 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:40.447 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:40.514 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:40.558 INFO:tasks.workunit.client.0.smithi084.stdout: 50363 ? 00:00:00 ps 2024-04-14T11:01:40.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:40.572 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:40.575 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:40.580 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:40.580 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.582 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:40.583 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:40.591 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:40.597 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:40.599 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:40.654 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:40.696 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:40.696 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:40.696 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:40.696 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:40.696 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:40.696 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:40.697 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:40.697 INFO:tasks.workunit.client.0.smithi084.stdout: 50373 ? 00:00:00 ps 2024-04-14T11:01:40.698 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:40.711 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:40.714 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:40.720 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:40.720 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.722 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:40.723 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:40.737 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:40.744 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:40.745 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:40.778 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:40.821 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:40.821 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:40.821 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:40.821 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:40.821 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:40.821 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:40.822 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:40.822 INFO:tasks.workunit.client.0.smithi084.stdout: 50383 ? 00:00:00 ps 2024-04-14T11:01:40.824 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:40.836 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:40.839 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:40.844 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:40.844 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.846 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:40.847 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:40.857 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:40.863 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:40.864 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:40.920 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:40.962 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:40.962 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:40.962 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:40.962 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:40.962 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:40.962 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:40.963 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:40.963 INFO:tasks.workunit.client.0.smithi084.stdout: 50393 ? 00:00:00 ps 2024-04-14T11:01:40.964 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:40.978 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:40.983 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:40.989 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:40.990 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:40.992 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:40.992 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.002 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.008 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.009 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.055 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:41.104 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:41.104 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:41.104 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:41.105 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:41.105 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:41.105 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:41.105 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:41.105 INFO:tasks.workunit.client.0.smithi084.stdout: 50403 ? 00:00:00 ps 2024-04-14T11:01:41.107 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:41.129 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:41.132 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:41.138 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:41.138 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:41.141 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:41.141 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.159 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.165 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.166 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.271 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:41.316 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:41.316 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:41.316 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:41.316 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:41.316 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:41.317 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:41.317 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:41.317 INFO:tasks.workunit.client.0.smithi084.stdout: 50413 ? 00:00:00 ps 2024-04-14T11:01:41.319 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:41.333 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:41.336 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:41.342 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:41.342 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:41.344 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:41.344 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.355 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.362 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.363 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.431 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:41.474 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:41.474 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:41.474 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:41.474 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:41.475 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:41.475 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:41.475 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:41.475 INFO:tasks.workunit.client.0.smithi084.stdout: 50423 ? 00:00:00 ps 2024-04-14T11:01:41.477 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:41.491 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:41.495 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:41.501 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:41.502 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:41.504 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:41.504 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.513 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.519 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.520 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.580 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:41.622 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:41.622 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:41.622 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:41.623 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:41.623 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:41.623 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:41.623 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:41.623 INFO:tasks.workunit.client.0.smithi084.stdout: 50433 ? 00:00:00 ps 2024-04-14T11:01:41.625 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:41.639 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:41.642 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:41.647 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:41.647 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:41.649 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:41.649 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.658 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.664 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.666 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.714 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:41.756 INFO:tasks.workunit.client.0.smithi084.stdout: 50443 ? 00:00:00 ps 2024-04-14T11:01:41.758 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:41.770 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:41.773 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:41.778 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:41.778 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:41.781 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:41.781 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.791 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.798 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.847 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:41.889 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:41.889 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:41.889 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:41.889 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:41.890 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:41.890 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:41.890 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:41.890 INFO:tasks.workunit.client.0.smithi084.stdout: 50453 ? 00:00:00 ps 2024-04-14T11:01:41.893 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:41.904 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:41.906 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:41.910 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:41.910 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:41.912 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:41.912 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:41.921 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:41.927 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:41.928 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:41.963 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.005 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.005 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.005 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.005 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.005 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.006 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.006 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.006 INFO:tasks.workunit.client.0.smithi084.stdout: 50463 ? 00:00:00 ps 2024-04-14T11:01:42.007 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:42.019 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:42.021 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:42.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:42.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:42.028 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:42.029 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:42.038 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:42.044 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:42.045 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:42.088 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.143 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.143 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.143 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.143 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.143 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.143 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.144 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.144 INFO:tasks.workunit.client.0.smithi084.stdout: 50473 ? 00:00:00 ps 2024-04-14T11:01:42.147 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:42.172 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:42.176 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:42.181 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:42.181 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:42.183 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:42.184 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:42.193 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:42.199 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:42.200 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:42.331 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.378 INFO:tasks.workunit.client.0.smithi084.stdout: 50483 ? 00:00:00 ps 2024-04-14T11:01:42.380 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:42.394 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:42.397 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:42.401 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:42.401 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:42.404 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:42.404 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:42.414 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:42.420 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:42.421 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:42.491 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.534 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.534 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.534 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.534 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.534 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.535 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.535 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.535 INFO:tasks.workunit.client.0.smithi084.stdout: 50493 ? 00:00:00 ps 2024-04-14T11:01:42.536 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:42.550 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:42.552 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:42.556 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:42.556 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:42.558 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:42.559 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:42.568 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:42.575 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:42.576 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:42.683 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.725 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.726 INFO:tasks.workunit.client.0.smithi084.stdout: 50503 ? 00:00:00 ps 2024-04-14T11:01:42.728 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:42.742 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:42.745 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:42.749 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:42.749 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:42.751 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:42.752 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:42.762 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:42.770 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:42.771 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:42.815 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.857 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.857 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.857 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.857 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.857 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.858 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.858 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.858 INFO:tasks.workunit.client.0.smithi084.stdout: 50513 ? 00:00:00 ps 2024-04-14T11:01:42.859 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:42.874 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:42.876 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:42.880 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:42.880 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:42.882 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:42.883 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:42.893 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:42.900 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:42.901 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:42.957 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:42.997 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:42.998 INFO:tasks.workunit.client.0.smithi084.stdout: 50523 ? 00:00:00 ps 2024-04-14T11:01:43.001 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:43.016 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:43.018 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:43.022 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:43.022 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:43.024 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:43.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:43.035 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:43.041 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:43.042 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:43.091 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:43.151 INFO:tasks.workunit.client.0.smithi084.stdout: 50533 ? 00:00:00 ps 2024-04-14T11:01:43.154 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:43.182 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:43.186 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:43.193 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 20` 2024-04-14T11:01:43.194 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a 2024-04-14T11:01:43.197 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/one 2024-04-14T11:01:43.197 INFO:tasks.workunit.client.0.smithi084.stderr:+ cat 2024-04-14T11:01:43.212 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir a/.snap/two 2024-04-14T11:01:43.229 INFO:tasks.workunit.client.0.smithi084.stderr:+ chmod 777 a/foo 2024-04-14T11:01:43.231 INFO:tasks.workunit.client.0.smithi084.stderr:+ sync 2024-04-14T11:01:43.449 INFO:tasks.workunit.client.0.smithi084.stderr:+ ps 2024-04-14T11:01:43.492 INFO:tasks.workunit.client.0.smithi084.stdout: PID TTY TIME CMD 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 1211 ? 00:00:00 systemd 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 1213 ? 00:00:00 (sd-pam) 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 23509 ? 00:00:00 sshd 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 46512 ? 00:00:00 bash 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 50326 ? 00:00:00 timeout 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 50344 ? 00:00:00 snaptest-double 2024-04-14T11:01:43.493 INFO:tasks.workunit.client.0.smithi084.stdout: 50543 ? 00:00:00 ps 2024-04-14T11:01:43.496 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-14T11:01:43.510 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm a/foo 2024-04-14T11:01:43.512 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir a 2024-04-14T11:01:43.517 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:01:43.518 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:01:43.518 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:01:43.518 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:01:43.595 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-04-14T11:01:43.596 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-04-14T11:01:43.659 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/foo 2024-04-14T11:01:43.669 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2024-04-14T11:01:43.669 INFO:tasks.workunit.client.0.smithi084.stdout:We want ENOENT, not ESTALE, here. 2024-04-14T11:01:43.669 INFO:tasks.workunit.client.0.smithi084.stderr:++ seq 1 100 2024-04-14T11:01:43.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/1 2024-04-14T11:01:43.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.672 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-04-14T11:01:43.673 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.673 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/2 2024-04-14T11:01:43.673 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.675 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-04-14T11:01:43.676 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.676 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/3 2024-04-14T11:01:43.676 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.678 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-04-14T11:01:43.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/4 2024-04-14T11:01:43.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.682 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-04-14T11:01:43.682 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.682 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/5 2024-04-14T11:01:43.682 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.685 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-04-14T11:01:43.685 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.685 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/6 2024-04-14T11:01:43.685 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.687 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-04-14T11:01:43.688 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.688 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/7 2024-04-14T11:01:43.688 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.690 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-04-14T11:01:43.691 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.691 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/8 2024-04-14T11:01:43.691 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.693 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-04-14T11:01:43.693 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.693 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/9 2024-04-14T11:01:43.694 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.696 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-04-14T11:01:43.696 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.696 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/10 2024-04-14T11:01:43.696 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.698 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-04-14T11:01:43.699 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.699 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/11 2024-04-14T11:01:43.699 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.701 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-04-14T11:01:43.702 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.702 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/12 2024-04-14T11:01:43.702 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.704 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-04-14T11:01:43.704 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.704 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/13 2024-04-14T11:01:43.704 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.707 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-04-14T11:01:43.707 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.707 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/14 2024-04-14T11:01:43.707 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.709 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-04-14T11:01:43.710 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.710 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/15 2024-04-14T11:01:43.710 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.712 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-04-14T11:01:43.712 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.712 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/16 2024-04-14T11:01:43.712 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.714 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-04-14T11:01:43.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/17 2024-04-14T11:01:43.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.717 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-04-14T11:01:43.717 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.718 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/18 2024-04-14T11:01:43.718 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.719 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-04-14T11:01:43.720 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.720 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/19 2024-04-14T11:01:43.720 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.722 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-04-14T11:01:43.723 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.723 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/20 2024-04-14T11:01:43.723 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.725 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-04-14T11:01:43.725 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.725 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/21 2024-04-14T11:01:43.725 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.729 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-04-14T11:01:43.730 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.730 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/22 2024-04-14T11:01:43.730 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.731 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-04-14T11:01:43.731 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.731 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/23 2024-04-14T11:01:43.731 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.733 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-04-14T11:01:43.733 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.733 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/24 2024-04-14T11:01:43.733 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.735 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-04-14T11:01:43.736 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.736 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/25 2024-04-14T11:01:43.736 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.738 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-04-14T11:01:43.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/26 2024-04-14T11:01:43.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.741 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-04-14T11:01:43.741 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.741 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/27 2024-04-14T11:01:43.741 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.744 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-04-14T11:01:43.744 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.744 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/28 2024-04-14T11:01:43.744 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.746 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-04-14T11:01:43.747 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.747 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/29 2024-04-14T11:01:43.747 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.749 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-04-14T11:01:43.749 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.749 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/30 2024-04-14T11:01:43.749 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.751 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-04-14T11:01:43.752 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.752 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/31 2024-04-14T11:01:43.752 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.754 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-04-14T11:01:43.755 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.755 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/32 2024-04-14T11:01:43.755 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.757 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-04-14T11:01:43.757 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.757 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/33 2024-04-14T11:01:43.757 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.760 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-04-14T11:01:43.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/34 2024-04-14T11:01:43.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.763 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-04-14T11:01:43.763 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.763 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/35 2024-04-14T11:01:43.763 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.765 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-04-14T11:01:43.766 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.766 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/36 2024-04-14T11:01:43.766 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.768 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-04-14T11:01:43.768 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.768 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/37 2024-04-14T11:01:43.769 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.770 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-04-14T11:01:43.771 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.771 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/38 2024-04-14T11:01:43.771 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.773 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-04-14T11:01:43.773 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.774 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/39 2024-04-14T11:01:43.774 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.776 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-04-14T11:01:43.776 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.776 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/40 2024-04-14T11:01:43.777 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.778 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-04-14T11:01:43.779 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.779 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/41 2024-04-14T11:01:43.779 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.781 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-04-14T11:01:43.782 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.782 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/42 2024-04-14T11:01:43.782 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.784 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-04-14T11:01:43.784 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.784 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/43 2024-04-14T11:01:43.784 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.786 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-04-14T11:01:43.787 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.787 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/44 2024-04-14T11:01:43.787 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.789 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-04-14T11:01:43.789 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.789 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/45 2024-04-14T11:01:43.789 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.791 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-04-14T11:01:43.792 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.792 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/46 2024-04-14T11:01:43.792 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.794 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-04-14T11:01:43.794 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.795 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/47 2024-04-14T11:01:43.795 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.796 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-04-14T11:01:43.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/48 2024-04-14T11:01:43.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.799 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-04-14T11:01:43.800 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.800 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/49 2024-04-14T11:01:43.800 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.802 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-04-14T11:01:43.802 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.802 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/50 2024-04-14T11:01:43.803 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.805 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-04-14T11:01:43.805 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.805 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/51 2024-04-14T11:01:43.805 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.807 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-04-14T11:01:43.808 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.808 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/52 2024-04-14T11:01:43.808 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.810 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-04-14T11:01:43.811 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.811 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/53 2024-04-14T11:01:43.811 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.813 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-04-14T11:01:43.813 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.813 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/54 2024-04-14T11:01:43.813 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.815 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-04-14T11:01:43.816 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.816 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/55 2024-04-14T11:01:43.816 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.818 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-04-14T11:01:43.819 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.819 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/56 2024-04-14T11:01:43.819 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.821 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-04-14T11:01:43.822 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.822 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/57 2024-04-14T11:01:43.822 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.824 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-04-14T11:01:43.825 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.825 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/58 2024-04-14T11:01:43.825 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.827 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-04-14T11:01:43.827 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.827 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/59 2024-04-14T11:01:43.827 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.830 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-04-14T11:01:43.830 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.830 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/60 2024-04-14T11:01:43.830 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.832 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-04-14T11:01:43.833 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.833 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/61 2024-04-14T11:01:43.833 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.835 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-04-14T11:01:43.835 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.835 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/62 2024-04-14T11:01:43.835 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.837 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-04-14T11:01:43.838 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.838 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/63 2024-04-14T11:01:43.838 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.840 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-04-14T11:01:43.840 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.840 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/64 2024-04-14T11:01:43.840 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.842 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-04-14T11:01:43.843 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.843 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/65 2024-04-14T11:01:43.843 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.845 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-04-14T11:01:43.845 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.845 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/66 2024-04-14T11:01:43.846 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.847 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-04-14T11:01:43.848 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.848 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/67 2024-04-14T11:01:43.848 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.850 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-04-14T11:01:43.850 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.851 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/68 2024-04-14T11:01:43.851 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.853 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-04-14T11:01:43.853 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.853 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/69 2024-04-14T11:01:43.853 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.855 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-04-14T11:01:43.855 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.855 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/70 2024-04-14T11:01:43.856 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.857 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-04-14T11:01:43.858 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.858 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/71 2024-04-14T11:01:43.858 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.860 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-04-14T11:01:43.861 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.861 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/72 2024-04-14T11:01:43.861 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.863 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-04-14T11:01:43.864 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.864 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/73 2024-04-14T11:01:43.864 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.866 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-04-14T11:01:43.867 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.867 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/74 2024-04-14T11:01:43.867 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.869 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-04-14T11:01:43.869 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.869 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/75 2024-04-14T11:01:43.870 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.871 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-04-14T11:01:43.872 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.872 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/76 2024-04-14T11:01:43.872 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.875 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-04-14T11:01:43.875 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.876 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/77 2024-04-14T11:01:43.876 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.876 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-04-14T11:01:43.877 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.877 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/78 2024-04-14T11:01:43.877 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.879 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-04-14T11:01:43.880 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.880 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/79 2024-04-14T11:01:43.880 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.882 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-04-14T11:01:43.882 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.883 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/80 2024-04-14T11:01:43.883 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.884 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-04-14T11:01:43.885 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.885 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/81 2024-04-14T11:01:43.885 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.887 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-04-14T11:01:43.887 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.887 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/82 2024-04-14T11:01:43.888 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.889 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-04-14T11:01:43.890 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.890 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/83 2024-04-14T11:01:43.890 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.892 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-04-14T11:01:43.892 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.893 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/84 2024-04-14T11:01:43.893 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.894 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-04-14T11:01:43.895 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.895 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/85 2024-04-14T11:01:43.895 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.897 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-04-14T11:01:43.897 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.897 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/86 2024-04-14T11:01:43.898 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.899 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-04-14T11:01:43.900 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.900 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/87 2024-04-14T11:01:43.900 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.902 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-04-14T11:01:43.902 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.903 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/88 2024-04-14T11:01:43.903 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.904 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-04-14T11:01:43.905 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.905 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/89 2024-04-14T11:01:43.905 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.907 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-04-14T11:01:43.907 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.907 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/90 2024-04-14T11:01:43.908 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.910 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-04-14T11:01:43.910 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.910 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/91 2024-04-14T11:01:43.910 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.912 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-04-14T11:01:43.913 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.913 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/92 2024-04-14T11:01:43.913 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.915 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-04-14T11:01:43.915 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.915 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/93 2024-04-14T11:01:43.915 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.917 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-04-14T11:01:43.918 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.918 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/94 2024-04-14T11:01:43.918 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.920 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-04-14T11:01:43.920 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.921 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/95 2024-04-14T11:01:43.921 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.924 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-04-14T11:01:43.924 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.924 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/96 2024-04-14T11:01:43.924 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.925 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-04-14T11:01:43.926 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.926 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/97 2024-04-14T11:01:43.926 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.928 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-04-14T11:01:43.928 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.928 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/98 2024-04-14T11:01:43.929 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.930 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-04-14T11:01:43.931 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.931 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/99 2024-04-14T11:01:43.931 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.934 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-04-14T11:01:43.934 INFO:tasks.workunit.client.0.smithi084.stderr:+ for f in `seq 1 100` 2024-04-14T11:01:43.934 INFO:tasks.workunit.client.0.smithi084.stderr:+ stat .snap/foo/100 2024-04-14T11:01:43.934 INFO:tasks.workunit.client.0.smithi084.stderr:+ grep 'No such file' 2024-04-14T11:01:43.936 INFO:tasks.workunit.client.0.smithi084.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-04-14T11:01:43.936 INFO:tasks.workunit.client.0.smithi084.stderr:+ rmdir .snap/foo 2024-04-14T11:01:43.943 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-04-14T11:01:43.944 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-04-14T11:01:43.944 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-14T11:01:43.944 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-14T11:01:44.017 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-04-14T11:01:44.018 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-04-14T11:01:44.087 INFO:tasks.workunit.client.0.smithi084.stderr:+ set -e 2024-04-14T11:01:44.087 INFO:tasks.workunit.client.0.smithi084.stderr:+ sudo git config --global http.sslVerify false 2024-04-14T11:01:44.121 INFO:tasks.workunit.client.0.smithi084.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-04-14T11:01:44.151 INFO:tasks.workunit.client.0.smithi084.stderr:+ retried=false 2024-04-14T11:01:44.151 INFO:tasks.workunit.client.0.smithi084.stderr:+ trap -- retry EXIT 2024-04-14T11:01:44.151 INFO:tasks.workunit.client.0.smithi084.stderr:+ rm -rf ceph 2024-04-14T11:01:44.151 INFO:tasks.workunit.client.0.smithi084.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-04-14T11:01:44.157 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into 'ceph'... 2024-04-14T11:02:04.458 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:02:04.461 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:02:34.604 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:02:34.607 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:03:04.758 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:03:04.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:03:34.894 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:03:34.897 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:04:05.190 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:04:05.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:04:35.249 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:04:35.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:04:50.368 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 3% (439/12473) Updating files: 4% (499/12473) Updating files: 5% (624/12473) Updating files: 6% (749/12473) Updating files: 6% (824/12473) Updating files: 7% (874/12473) Updating files: 8% (998/12473) Updating files: 8% (1120/12473) Updating files: 9% (1123/12473) Updating files: 10% (1248/12473) Updating files: 11% (1373/12473) Updating files: 11% (1436/12473) Updating files: 12% (1497/12473) Updating files: 13% (1622/12473) Updating files: 13% (1656/12473) Updating files: 14% (1747/12473) Updating files: 15% (1871/12473) Updating files: 15% (1882/12473) Updating files: 16% (1996/12473) Updating files: 16% (2101/12473) Updating files: 17% (2121/12473) Updating files: 18% (2246/12473) Updating files: 18% (2328/12473) Updating files: 19% (2370/12473) Updating files: 19% (2473/12473) Updating files: 20% (2495/12473) Updating files: 21% (2620/12473) Updating files: 21% (2741/12473) Updating files: 22% (2745/12473) Updating files: 23% (2869/12473) Updating files: 24% (2994/12473) Updating files: 24% (3019/12473) Updating files: 25% (3119/12473) Updating files: 26% (3243/12473) Updating files: 26% (3362/12473) Updating files: 27% (3368/12473) Updating files: 28% (3493/12473) Updating files: 29% (3618/12473) Updating files: 29% (3672/12473) Updating files: 30% (3742/12473) Updating files: 31% (3867/12473) Updating files: 31% (3882/12473) Updating files: 32% (3992/12473) Updating files: 33% (4117/12473) Updating files: 33% (4202/12473) Updating files: 34% (4241/12473) Updating files: 35% (4366/12473) Updating files: 35% (4459/12473) Updating files: 36% (4491/12473) Updating files: 37% (4616/12473) Updating files: 38% (4740/12473) Updating files: 38% (4815/12473) Updating files: 39% (4865/12473) Updating files: 40% (4990/12473) Updating files: 40% (5059/12473) Updating files: 41% (5114/12473) Updating files: 42% (5239/12473) Updating files: 42% (5357/12473) Updating files: 43% (5364/12473) Updating files: 44% (5489/12473) Updating files: 45% (5613/12473) Updating files: 46% (5738/12473) Updating files: 47% (5863/12473) Updating files: 47% (5941/12473) Updating files: 48% (5988/12473) Updating files: 49% (6112/12473) Updating files: 50% (6237/12473) Updating files: 50% (6272/12473) Updating files: 51% (6362/12473) Updating files: 52% (6486/12473) Updating files: 53% (6611/12473) Updating files: 53% (6647/12473) Updating files: 54% (6736/12473) Updating files: 55% (6861/12473) Updating files: 55% (6931/12473) Updating files: 56% (6985/12473) Updating files: 57% (7110/12473) Updating files: 58% (7235/12473) Updating files: 58% (7315/12473) Updating files: 59% (7360/12473) Updating files: 60% (7484/12473) Updating files: 61% (7609/12473) Updating files: 61% (7637/12473) Updating files: 62% (7734/12473) Updating files: 63% (7858/12473) Updating files: 64% (7983/12473) Updating files: 64% (8006/12473) Updating files: 65% (8108/12473) Updating files: 65% (8226/12473) Updating files: 66% (8233/12473) Updating files: 67% (8357/12473) Updating files: 67% (8460/12473) Updating files: 68% (8482/12473) Updating files: 68% (8597/12473) Updating files: 69% (8607/12473) Updating files: 70% (8732/12473) Updating files: 70% (8780/12473) Updating files: 71% (8856/12473) Updating files: 71% (8980/12473) Updating files: 72% (8981/12473) Updating files: 73% (9106/12473) Updating files: 73% (9220/12473) Updating files: 74% (9231/12473) Updating files: 75% (9355/12473) Updating files: 75% (9377/12473) Updating files: 76% (9480/12473) Updating files: 77% (9605/12473) Updating files: 77% (9619/12473) Updating files: 78% (9729/12473) Updating files: 79% (9854/12473) Updating files: 79% (9875/12473) Updating files: 79% (9948/12473) Updating files: 80% (9979/12473) Updating files: 81% (10104/12473) Updating files: 82% (10228/12473) Updating files: 82% (10254/12473) Updating files: 83% (10353/12473) Updating files: 84% (10478/12473) Updating files: 84% (10542/12473) Updating files: 85% (10603/12473) Updating files: 85% (10617/12473) Updating files: 86% (10727/12473) Updating files: 87% (10852/12473) Updating files: 88% (10977/12473) Updating files: 88% (11009/12473) Updating files: 89% (11101/12473) Updating files: 89% (11223/12473) Updating files: 90% (11226/12473) Updating files: 91% (11351/12473) Updating files: 92% (11476/12473) Updating files: 92% (11534/12473) Updating files: 93% (11600/12473) Updating files: 94% (11725/12473) Updating files: 95% (11850/12473) Updating files: 95% (11912/12473) Updating files: 96% (11975/12473) Updating files: 97% (12099/12473) Updating files: 98% (12224/12473) Updating files: 98% (12255/12473) Updating files: 99% (12349/12473) Updating files: 100% (12473/12473) Updating files: 100% (12473/12473), done. 2024-04-14T11:04:50.403 INFO:tasks.workunit.client.0.smithi084.stderr:+ trap - EXIT 2024-04-14T11:04:50.403 INFO:tasks.workunit.client.0.smithi084.stderr:+ cd ceph 2024-04-14T11:04:50.403 INFO:tasks.workunit.client.0.smithi084.stderr:++ seq 1 90 2024-04-14T11:04:50.403 INFO:tasks.workunit.client.0.smithi084.stderr:+ versions='1 2024-04-14T11:04:50.403 INFO:tasks.workunit.client.0.smithi084.stderr:2 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:3 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:4 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:5 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:6 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:7 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:8 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:9 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:10 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:11 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:12 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:13 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:14 2024-04-14T11:04:50.404 INFO:tasks.workunit.client.0.smithi084.stderr:15 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:16 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:17 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:18 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:19 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:20 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:21 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:22 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:23 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:24 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:25 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:26 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:27 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:28 2024-04-14T11:04:50.405 INFO:tasks.workunit.client.0.smithi084.stderr:29 2024-04-14T11:04:50.406 INFO:tasks.workunit.client.0.smithi084.stderr:30 2024-04-14T11:04:50.406 INFO:tasks.workunit.client.0.smithi084.stderr:31 2024-04-14T11:04:50.406 INFO:tasks.workunit.client.0.smithi084.stderr:32 2024-04-14T11:04:50.406 INFO:tasks.workunit.client.0.smithi084.stderr:33 2024-04-14T11:04:50.406 INFO:tasks.workunit.client.0.smithi084.stderr:34 2024-04-14T11:04:50.406 INFO:tasks.workunit.client.0.smithi084.stderr:35 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:36 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:37 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:38 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:39 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:40 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:41 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:42 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:43 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:44 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:45 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:46 2024-04-14T11:04:50.407 INFO:tasks.workunit.client.0.smithi084.stderr:47 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:48 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:49 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:50 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:51 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:52 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:53 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:54 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:55 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:56 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:57 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:58 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:59 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:60 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:61 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:62 2024-04-14T11:04:50.408 INFO:tasks.workunit.client.0.smithi084.stderr:63 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:64 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:65 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:66 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:67 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:68 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:69 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:70 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:71 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:72 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:73 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:74 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:75 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:76 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:77 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:78 2024-04-14T11:04:50.409 INFO:tasks.workunit.client.0.smithi084.stderr:79 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:80 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:81 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:82 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:83 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:84 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:85 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:86 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:87 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:88 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:89 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:90' 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 1 -eq 48 ']' 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.1 2024-04-14T11:04:50.410 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.1 2024-04-14T11:04:50.411 INFO:tasks.workunit.client.0.smithi084.stdout:v0.1 2024-04-14T11:04:50.411 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.1 2024-04-14T11:05:05.323 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:05:05.326 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:05:35.795 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:05:35.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:05:39.901 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 2% (308/13263) Updating files: 3% (398/13263) Updating files: 4% (531/13263) Updating files: 4% (642/13263) Updating files: 5% (664/13263) Updating files: 6% (796/13263) Updating files: 6% (912/13263) Updating files: 7% (929/13263) Updating files: 8% (1062/13263) Updating files: 8% (1114/13263) Updating files: 9% (1194/13263) Updating files: 10% (1327/13263) Updating files: 10% (1338/13263) Updating files: 11% (1459/13263) Updating files: 11% (1568/13263) Updating files: 12% (1592/13263) Updating files: 13% (1725/13263) Updating files: 13% (1777/13263) Updating files: 14% (1857/13263) Updating files: 15% (1990/13263) Updating files: 15% (2011/13263) Updating files: 16% (2123/13263) Updating files: 16% (2233/13263) Updating files: 17% (2255/13263) Updating files: 18% (2388/13263) Updating files: 18% (2432/13263) Updating files: 19% (2520/13263) Updating files: 20% (2653/13263) Updating files: 21% (2786/13263) Updating files: 21% (2890/13263) Updating files: 22% (2918/13263) Updating files: 23% (3051/13263) Updating files: 23% (3135/13263) Updating files: 24% (3184/13263) Updating files: 25% (3316/13263) Updating files: 25% (3423/13263) Updating files: 26% (3449/13263) Updating files: 27% (3582/13263) Updating files: 27% (3648/13263) Updating files: 28% (3714/13263) Updating files: 29% (3847/13263) Updating files: 29% (3863/13263) Updating files: 30% (3979/13263) Updating files: 31% (4112/13263) Updating files: 31% (4122/13263) Updating files: 32% (4245/13263) Updating files: 32% (4363/13263) Updating files: 33% (4377/13263) Updating files: 34% (4510/13263) Updating files: 34% (4593/13263) Updating files: 35% (4643/13263) Updating files: 36% (4775/13263) Updating files: 37% (4908/13263) Updating files: 37% (4931/13263) Updating files: 38% (5040/13263) Updating files: 39% (5173/13263) Updating files: 39% (5231/13263) Updating files: 40% (5306/13263) Updating files: 41% (5438/13263) Updating files: 41% (5446/13263) Updating files: 42% (5571/13263) Updating files: 43% (5704/13263) Updating files: 43% (5793/13263) Updating files: 44% (5836/13263) Updating files: 45% (5969/13263) Updating files: 46% (6101/13263) Updating files: 46% (6140/13263) Updating files: 47% (6234/13263) Updating files: 48% (6367/13263) Updating files: 48% (6449/13263) Updating files: 49% (6499/13263) Updating files: 50% (6632/13263) Updating files: 50% (6743/13263) Updating files: 51% (6765/13263) Updating files: 52% (6897/13263) Updating files: 53% (7030/13263) Updating files: 53% (7080/13263) Updating files: 54% (7163/13263) Updating files: 55% (7295/13263) Updating files: 56% (7428/13263) Updating files: 56% (7481/13263) Updating files: 57% (7560/13263) Updating files: 58% (7693/13263) Updating files: 59% (7826/13263) Updating files: 59% (7828/13263) Updating files: 60% (7958/13263) Updating files: 61% (8091/13263) Updating files: 62% (8224/13263) Updating files: 62% (8281/13263) Updating files: 63% (8356/13263) Updating files: 63% (8457/13263) Updating files: 64% (8489/13263) Updating files: 65% (8621/13263) Updating files: 65% (8631/13263) Updating files: 66% (8754/13263) Updating files: 66% (8804/13263) Updating files: 67% (8887/13263) Updating files: 68% (9019/13263) Updating files: 68% (9023/13263) Updating files: 69% (9152/13263) Updating files: 69% (9203/13263) Updating files: 70% (9285/13263) Updating files: 71% (9417/13263) Updating files: 71% (9452/13263) Updating files: 72% (9550/13263) Updating files: 73% (9682/13263) Updating files: 73% (9745/13263) Updating files: 74% (9815/13263) Updating files: 75% (9948/13263) Updating files: 75% (9986/13263) Updating files: 76% (10080/13263) Updating files: 77% (10213/13263) Updating files: 78% (10346/13263) Updating files: 78% (10370/13263) Updating files: 79% (10478/13263) Updating files: 80% (10611/13263) Updating files: 80% (10676/13263) Updating files: 81% (10744/13263) Updating files: 82% (10876/13263) Updating files: 82% (10970/13263) Updating files: 83% (11009/13263) Updating files: 84% (11141/13263) Updating files: 85% (11274/13263) Updating files: 85% (11285/13263) Updating files: 86% (11407/13263) Updating files: 87% (11539/13263) Updating files: 87% (11573/13263) Updating files: 88% (11672/13263) Updating files: 89% (11805/13263) Updating files: 89% (11903/13263) Updating files: 90% (11937/13263) Updating files: 91% (12070/13263) Updating files: 92% (12202/13263) Updating files: 92% (12216/13263) Updating files: 93% (12335/13263) Updating files: 94% (12468/13263) Updating files: 94% (12562/13263) Updating files: 95% (12600/13263) Updating files: 96% (12733/13263) Updating files: 97% (12866/13263) Updating files: 97% (12906/13263) Updating files: 98% (12998/13263) Updating files: 99% (13131/13263) Updating files: 99% (13156/13263) Updating files: 100% (13263/13263) Updating files: 100% (13263/13263), done. 2024-04-14T11:05:39.975 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2024-04-14T11:05:39.978 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.1 2024-04-14T11:05:40.041 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:40.041 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 2 -eq 48 ']' 2024-04-14T11:05:40.041 INFO:tasks.workunit.client.0.smithi084.stdout:v0.2 2024-04-14T11:05:40.041 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.2 2024-04-14T11:05:40.041 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.2 2024-04-14T11:05:40.042 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.2 2024-04-14T11:05:41.892 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 2b5f76f48e9 readme 2024-04-14T11:05:41.894 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.2 2024-04-14T11:05:42.000 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:42.000 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 3 -eq 48 ']' 2024-04-14T11:05:42.000 INFO:tasks.workunit.client.0.smithi084.stdout:v0.3 2024-04-14T11:05:42.001 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.3 2024-04-14T11:05:42.001 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.3 2024-04-14T11:05:42.001 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.3 2024-04-14T11:05:44.151 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 64% (191/295) Updating files: 65% (192/295) Updating files: 66% (195/295) Updating files: 67% (198/295) Updating files: 68% (201/295) Updating files: 69% (204/295) Updating files: 70% (207/295) Updating files: 71% (210/295) Updating files: 72% (213/295) Updating files: 73% (216/295) Updating files: 74% (219/295) Updating files: 75% (222/295) Updating files: 76% (225/295) Updating files: 77% (228/295) Updating files: 78% (231/295) Updating files: 79% (234/295) Updating files: 80% (236/295) Updating files: 81% (239/295) Updating files: 82% (242/295) Updating files: 83% (245/295) Updating files: 84% (248/295) Updating files: 85% (251/295) Updating files: 86% (254/295) Updating files: 87% (257/295) Updating files: 88% (260/295) Updating files: 89% (263/295) Updating files: 90% (266/295) Updating files: 91% (269/295) Updating files: 92% (272/295) Updating files: 93% (275/295) Updating files: 94% (278/295) Updating files: 95% (281/295) Updating files: 96% (284/295) Updating files: 97% (287/295) Updating files: 98% (290/295) Updating files: 99% (293/295) Updating files: 100% (295/295) Updating files: 100% (295/295), done. 2024-04-14T11:05:44.205 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2024-04-14T11:05:44.208 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.3 2024-04-14T11:05:44.400 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:44.400 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 4 -eq 48 ']' 2024-04-14T11:05:44.401 INFO:tasks.workunit.client.0.smithi084.stdout:v0.4 2024-04-14T11:05:44.401 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.4 2024-04-14T11:05:44.401 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.4 2024-04-14T11:05:44.401 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.4 2024-04-14T11:05:45.817 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 97% (241/247) Updating files: 98% (243/247) Updating files: 99% (245/247) Updating files: 100% (247/247) Updating files: 100% (247/247), done. 2024-04-14T11:05:45.858 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2024-04-14T11:05:45.861 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.4 2024-04-14T11:05:46.036 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:46.036 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 5 -eq 48 ']' 2024-04-14T11:05:46.037 INFO:tasks.workunit.client.0.smithi084.stdout:v0.5 2024-04-14T11:05:46.037 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.5 2024-04-14T11:05:46.037 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.5 2024-04-14T11:05:46.037 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.5 2024-04-14T11:05:47.619 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 92% (227/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-14T11:05:47.728 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2024-04-14T11:05:47.730 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.5 2024-04-14T11:05:47.986 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:47.986 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 6 -eq 48 ']' 2024-04-14T11:05:47.986 INFO:tasks.workunit.client.0.smithi084.stdout:v0.6 2024-04-14T11:05:47.986 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.6 2024-04-14T11:05:47.987 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.6 2024-04-14T11:05:47.987 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.6 2024-04-14T11:05:49.614 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 87% (199/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-14T11:05:49.709 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at a4c752df713 v0.6 2024-04-14T11:05:49.711 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.6 2024-04-14T11:05:49.759 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:49.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 7 -eq 48 ']' 2024-04-14T11:05:49.760 INFO:tasks.workunit.client.0.smithi084.stdout:v0.7 2024-04-14T11:05:49.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.7 2024-04-14T11:05:49.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.7 2024-04-14T11:05:49.760 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.7 2024-04-14T11:05:51.246 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2024-04-14T11:05:51.247 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.7 2024-04-14T11:05:51.393 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:51.393 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 8 -eq 48 ']' 2024-04-14T11:05:51.394 INFO:tasks.workunit.client.0.smithi084.stdout:v0.8 2024-04-14T11:05:51.394 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.8 2024-04-14T11:05:51.394 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.8 2024-04-14T11:05:51.394 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.8 2024-04-14T11:05:52.935 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 93% (210/225) Updating files: 94% (212/225) Updating files: 95% (214/225) Updating files: 96% (216/225) Updating files: 97% (219/225) Updating files: 98% (221/225) Updating files: 99% (223/225) Updating files: 100% (225/225) Updating files: 100% (225/225), done. 2024-04-14T11:05:52.978 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2024-04-14T11:05:52.980 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.8 2024-04-14T11:05:53.051 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:53.051 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 9 -eq 48 ']' 2024-04-14T11:05:53.052 INFO:tasks.workunit.client.0.smithi084.stdout:v0.9 2024-04-14T11:05:53.052 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.9 2024-04-14T11:05:53.052 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.9 2024-04-14T11:05:53.052 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.9 2024-04-14T11:05:54.578 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2024-04-14T11:05:54.580 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.9 2024-04-14T11:05:54.618 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:54.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 10 -eq 48 ']' 2024-04-14T11:05:54.619 INFO:tasks.workunit.client.0.smithi084.stdout:v0.10 2024-04-14T11:05:54.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.10 2024-04-14T11:05:54.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.10 2024-04-14T11:05:54.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.10 2024-04-14T11:05:55.990 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 007313fe844 v0.10 2024-04-14T11:05:55.993 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.10 2024-04-14T11:05:56.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:56.095 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 11 -eq 48 ']' 2024-04-14T11:05:56.095 INFO:tasks.workunit.client.0.smithi084.stdout:v0.11 2024-04-14T11:05:56.095 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.11 2024-04-14T11:05:56.096 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.11 2024-04-14T11:05:56.096 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.11 2024-04-14T11:05:57.174 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2024-04-14T11:05:57.176 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.11 2024-04-14T11:05:57.205 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:57.206 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 12 -eq 48 ']' 2024-04-14T11:05:57.206 INFO:tasks.workunit.client.0.smithi084.stdout:v0.12 2024-04-14T11:05:57.206 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.12 2024-04-14T11:05:57.206 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.12 2024-04-14T11:05:57.206 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.12 2024-04-14T11:05:58.063 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at f524150822a v0.12 2024-04-14T11:05:58.065 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.12 2024-04-14T11:05:58.214 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:58.214 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 13 -eq 48 ']' 2024-04-14T11:05:58.214 INFO:tasks.workunit.client.0.smithi084.stdout:v0.13 2024-04-14T11:05:58.214 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.13 2024-04-14T11:05:58.214 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.13 2024-04-14T11:05:58.215 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.13 2024-04-14T11:05:59.410 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 2b32297267d v0.13 2024-04-14T11:05:59.411 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.13 2024-04-14T11:05:59.443 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:05:59.444 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 14 -eq 48 ']' 2024-04-14T11:05:59.444 INFO:tasks.workunit.client.0.smithi084.stdout:v0.14 2024-04-14T11:05:59.444 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.14 2024-04-14T11:05:59.445 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.14 2024-04-14T11:05:59.445 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.14 2024-04-14T11:06:00.690 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2024-04-14T11:06:00.692 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.14 2024-04-14T11:06:00.725 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:00.725 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 15 -eq 48 ']' 2024-04-14T11:06:00.726 INFO:tasks.workunit.client.0.smithi084.stdout:v0.15 2024-04-14T11:06:00.726 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.15 2024-04-14T11:06:00.726 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.15 2024-04-14T11:06:00.726 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.15 2024-04-14T11:06:01.900 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at ab3c421eb95 v0.15 2024-04-14T11:06:01.901 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.15 2024-04-14T11:06:02.024 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:02.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 16 -eq 48 ']' 2024-04-14T11:06:02.025 INFO:tasks.workunit.client.0.smithi084.stdout:v0.16 2024-04-14T11:06:02.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.16 2024-04-14T11:06:02.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.16 2024-04-14T11:06:02.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.16 2024-04-14T11:06:03.139 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 38dbaa5175c v0.16 2024-04-14T11:06:03.141 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.16 2024-04-14T11:06:03.186 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:03.186 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 17 -eq 48 ']' 2024-04-14T11:06:03.187 INFO:tasks.workunit.client.0.smithi084.stdout:v0.17 2024-04-14T11:06:03.187 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.17 2024-04-14T11:06:03.187 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.17 2024-04-14T11:06:03.187 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.17 2024-04-14T11:06:04.609 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at dac3a8c35fb v0.17 2024-04-14T11:06:04.611 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.17 2024-04-14T11:06:04.669 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:04.669 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 18 -eq 48 ']' 2024-04-14T11:06:04.670 INFO:tasks.workunit.client.0.smithi084.stdout:v0.18 2024-04-14T11:06:04.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.18 2024-04-14T11:06:04.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.18 2024-04-14T11:06:04.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.18 2024-04-14T11:06:05.861 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:06:05.864 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:06:07.706 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 42% (333/779) Updating files: 43% (335/779) Updating files: 44% (343/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 49% (382/779) Updating files: 50% (390/779) Updating files: 51% (398/779) Updating files: 52% (406/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 58% (452/779) Updating files: 59% (460/779) Updating files: 60% (468/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 71% (554/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 77% (600/779) Updating files: 77% (603/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 85% (663/779) Updating files: 86% (670/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 93% (725/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 96% (748/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2024-04-14T11:06:07.812 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 2f10137986a v0.18 2024-04-14T11:06:07.814 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.18 2024-04-14T11:06:07.894 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:07.894 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 19 -eq 48 ']' 2024-04-14T11:06:07.894 INFO:tasks.workunit.client.0.smithi084.stdout:v0.19 2024-04-14T11:06:07.894 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.19 2024-04-14T11:06:07.894 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.19 2024-04-14T11:06:07.895 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.19 2024-04-14T11:06:09.417 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 93% (203/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-14T11:06:09.540 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 98f5be53f85 v0.19 2024-04-14T11:06:09.541 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.19 2024-04-14T11:06:09.585 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:09.585 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 20 -eq 48 ']' 2024-04-14T11:06:09.585 INFO:tasks.workunit.client.0.smithi084.stdout:v0.20 2024-04-14T11:06:09.586 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.20 2024-04-14T11:06:09.586 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.20 2024-04-14T11:06:09.586 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.20 2024-04-14T11:06:10.954 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 91% (224/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-14T11:06:11.011 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2024-04-14T11:06:11.012 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.20 2024-04-14T11:06:11.111 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:11.111 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 21 -eq 48 ']' 2024-04-14T11:06:11.111 INFO:tasks.workunit.client.0.smithi084.stdout:v0.21 2024-04-14T11:06:11.111 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.21 2024-04-14T11:06:11.111 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.21 2024-04-14T11:06:11.111 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.21 2024-04-14T11:06:13.912 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 42% (227/537) Updating files: 43% (231/537) Updating files: 44% (237/537) Updating files: 45% (242/537) Updating files: 46% (248/537) Updating files: 47% (253/537) Updating files: 48% (258/537) Updating files: 49% (264/537) Updating files: 50% (269/537) Updating files: 51% (274/537) Updating files: 52% (280/537) Updating files: 53% (285/537) Updating files: 54% (290/537) Updating files: 55% (296/537) Updating files: 56% (301/537) Updating files: 57% (307/537) Updating files: 58% (312/537) Updating files: 59% (317/537) Updating files: 60% (323/537) Updating files: 61% (328/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 78% (424/537) Updating files: 79% (425/537) Updating files: 80% (430/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 98% (527/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2024-04-14T11:06:13.984 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 090436f56ac v0.21 2024-04-14T11:06:13.987 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.21 2024-04-14T11:06:14.024 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:14.024 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 22 -eq 48 ']' 2024-04-14T11:06:14.024 INFO:tasks.workunit.client.0.smithi084.stdout:v0.22 2024-04-14T11:06:14.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.22 2024-04-14T11:06:14.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.22 2024-04-14T11:06:14.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.22 2024-04-14T11:06:15.710 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 8a7c95f60ad v0.22 2024-04-14T11:06:15.712 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.22 2024-04-14T11:06:15.758 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:15.758 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 23 -eq 48 ']' 2024-04-14T11:06:15.758 INFO:tasks.workunit.client.0.smithi084.stdout:v0.23 2024-04-14T11:06:15.758 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.23 2024-04-14T11:06:15.758 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.23 2024-04-14T11:06:15.758 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.23 2024-04-14T11:06:16.948 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 5d1d8d0c460 v0.23 2024-04-14T11:06:16.950 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.23 2024-04-14T11:06:17.090 INFO:tasks.workunit.client.0.smithi084.stdout:v0.24 2024-04-14T11:06:17.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:17.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 24 -eq 48 ']' 2024-04-14T11:06:17.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.24 2024-04-14T11:06:17.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.24 2024-04-14T11:06:17.094 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.24 2024-04-14T11:06:18.682 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 180a4176035 v0.24 2024-04-14T11:06:18.684 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.24 2024-04-14T11:06:18.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:18.715 INFO:tasks.workunit.client.0.smithi084.stdout:v0.25 2024-04-14T11:06:18.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 25 -eq 48 ']' 2024-04-14T11:06:18.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.25 2024-04-14T11:06:18.715 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.25 2024-04-14T11:06:18.716 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.25 2024-04-14T11:06:21.414 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 41% (260/622) Updating files: 42% (262/622) Updating files: 43% (268/622) Updating files: 44% (274/622) Updating files: 45% (280/622) Updating files: 46% (287/622) Updating files: 47% (293/622) Updating files: 48% (299/622) Updating files: 49% (305/622) Updating files: 50% (311/622) Updating files: 51% (318/622) Updating files: 52% (324/622) Updating files: 53% (330/622) Updating files: 54% (336/622) Updating files: 55% (343/622) Updating files: 56% (349/622) Updating files: 57% (355/622) Updating files: 58% (361/622) Updating files: 59% (367/622) Updating files: 60% (374/622) Updating files: 61% (380/622) Updating files: 62% (386/622) Updating files: 63% (392/622) Updating files: 64% (399/622) Updating files: 65% (405/622) Updating files: 66% (411/622) Updating files: 67% (417/622) Updating files: 68% (423/622) Updating files: 69% (430/622) Updating files: 70% (436/622) Updating files: 71% (442/622) Updating files: 72% (448/622) Updating files: 73% (455/622) Updating files: 74% (461/622) Updating files: 75% (467/622) Updating files: 76% (473/622) Updating files: 77% (479/622) Updating files: 78% (486/622) Updating files: 79% (492/622) Updating files: 80% (498/622) Updating files: 80% (501/622) Updating files: 81% (504/622) Updating files: 82% (511/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2024-04-14T11:06:21.515 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 3fa121bf0a8 v0.25 2024-04-14T11:06:21.517 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.25 2024-04-14T11:06:21.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:21.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 26 -eq 48 ']' 2024-04-14T11:06:21.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.26 2024-04-14T11:06:21.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.26 2024-04-14T11:06:21.561 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.26 2024-04-14T11:06:21.561 INFO:tasks.workunit.client.0.smithi084.stdout:v0.26 2024-04-14T11:06:23.177 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 91% (219/239) Updating files: 92% (220/239) Updating files: 93% (223/239) Updating files: 94% (225/239) Updating files: 95% (228/239) Updating files: 96% (230/239) Updating files: 97% (232/239) Updating files: 98% (235/239) Updating files: 99% (237/239) Updating files: 100% (239/239) Updating files: 100% (239/239), done. 2024-04-14T11:06:23.319 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 9981ff90968 v0.26 2024-04-14T11:06:23.321 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.26 2024-04-14T11:06:23.484 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:23.484 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 27 -eq 48 ']' 2024-04-14T11:06:23.484 INFO:tasks.workunit.client.0.smithi084.stdout:v0.27 2024-04-14T11:06:23.484 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.27 2024-04-14T11:06:23.484 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.27 2024-04-14T11:06:23.484 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.27 2024-04-14T11:06:25.220 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 79% (200/253) Updating files: 80% (203/253) Updating files: 81% (205/253) Updating files: 82% (208/253) Updating files: 83% (210/253) Updating files: 84% (213/253) Updating files: 85% (216/253) Updating files: 86% (218/253) Updating files: 87% (221/253) Updating files: 88% (223/253) Updating files: 89% (226/253) Updating files: 90% (228/253) Updating files: 91% (231/253) Updating files: 92% (233/253) Updating files: 93% (236/253) Updating files: 94% (238/253) Updating files: 95% (241/253) Updating files: 96% (243/253) Updating files: 97% (246/253) Updating files: 98% (248/253) Updating files: 99% (251/253) Updating files: 100% (253/253) Updating files: 100% (253/253), done. 2024-04-14T11:06:25.283 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 793034c62c8 v0.27 2024-04-14T11:06:25.285 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.27 2024-04-14T11:06:25.348 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:25.348 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 28 -eq 48 ']' 2024-04-14T11:06:25.349 INFO:tasks.workunit.client.0.smithi084.stdout:v0.28 2024-04-14T11:06:25.349 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.28 2024-04-14T11:06:25.349 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.28 2024-04-14T11:06:25.349 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.28 2024-04-14T11:06:27.101 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 87% (199/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-14T11:06:27.198 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 071881d7e55 v0.28 2024-04-14T11:06:27.200 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.28 2024-04-14T11:06:27.256 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:27.257 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 29 -eq 48 ']' 2024-04-14T11:06:27.257 INFO:tasks.workunit.client.0.smithi084.stdout:v0.29 2024-04-14T11:06:27.257 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.29 2024-04-14T11:06:27.257 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.29 2024-04-14T11:06:27.257 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.29 2024-04-14T11:06:28.558 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 8e69c39f699 v0.29 2024-04-14T11:06:28.560 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.29 2024-04-14T11:06:28.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:28.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 30 -eq 48 ']' 2024-04-14T11:06:28.739 INFO:tasks.workunit.client.0.smithi084.stdout:v0.30 2024-04-14T11:06:28.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.30 2024-04-14T11:06:28.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.30 2024-04-14T11:06:28.740 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.30 2024-04-14T11:06:30.466 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 78% (224/285) Updating files: 79% (226/285) Updating files: 80% (228/285) Updating files: 81% (231/285) Updating files: 82% (234/285) Updating files: 83% (237/285) Updating files: 84% (240/285) Updating files: 85% (243/285) Updating files: 86% (246/285) Updating files: 87% (248/285) Updating files: 88% (251/285) Updating files: 89% (254/285) Updating files: 90% (257/285) Updating files: 91% (260/285) Updating files: 92% (263/285) Updating files: 93% (266/285) Updating files: 94% (268/285) Updating files: 95% (271/285) Updating files: 96% (274/285) Updating files: 97% (277/285) Updating files: 98% (280/285) Updating files: 99% (283/285) Updating files: 100% (285/285) Updating files: 100% (285/285), done. 2024-04-14T11:06:30.553 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 64b1b2c70f0 v0.30 2024-04-14T11:06:30.555 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.30 2024-04-14T11:06:30.631 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:30.632 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 31 -eq 48 ']' 2024-04-14T11:06:30.632 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.31 2024-04-14T11:06:30.632 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.31 2024-04-14T11:06:30.632 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.31 2024-04-14T11:06:30.632 INFO:tasks.workunit.client.0.smithi084.stdout:v0.31 2024-04-14T11:06:33.053 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 50% (200/398) Updating files: 51% (203/398) Updating files: 52% (207/398) Updating files: 53% (211/398) Updating files: 54% (215/398) Updating files: 55% (219/398) Updating files: 56% (223/398) Updating files: 57% (227/398) Updating files: 58% (231/398) Updating files: 59% (235/398) Updating files: 60% (239/398) Updating files: 61% (243/398) Updating files: 62% (247/398) Updating files: 63% (251/398) Updating files: 64% (255/398) Updating files: 65% (259/398) Updating files: 66% (263/398) Updating files: 67% (267/398) Updating files: 68% (271/398) Updating files: 69% (275/398) Updating files: 70% (279/398) Updating files: 71% (283/398) Updating files: 72% (287/398) Updating files: 73% (291/398) Updating files: 74% (295/398) Updating files: 75% (299/398) Updating files: 76% (303/398) Updating files: 77% (307/398) Updating files: 78% (311/398) Updating files: 79% (315/398) Updating files: 80% (319/398) Updating files: 81% (323/398) Updating files: 82% (327/398) Updating files: 83% (331/398) Updating files: 84% (335/398) Updating files: 85% (339/398) Updating files: 86% (343/398) Updating files: 87% (347/398) Updating files: 88% (351/398) Updating files: 89% (355/398) Updating files: 90% (359/398) Updating files: 91% (363/398) Updating files: 92% (367/398) Updating files: 93% (371/398) Updating files: 94% (375/398) Updating files: 95% (379/398) Updating files: 96% (383/398) Updating files: 97% (387/398) Updating files: 97% (390/398) Updating files: 98% (391/398) Updating files: 99% (395/398) Updating files: 100% (398/398) Updating files: 100% (398/398), done. 2024-04-14T11:06:33.126 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 9019c6ce640 v0.31 2024-04-14T11:06:33.128 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.31 2024-04-14T11:06:33.235 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:33.235 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 32 -eq 48 ']' 2024-04-14T11:06:33.236 INFO:tasks.workunit.client.0.smithi084.stdout:v0.32 2024-04-14T11:06:33.236 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.32 2024-04-14T11:06:33.236 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.32 2024-04-14T11:06:33.236 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.32 2024-04-14T11:06:34.797 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at c08d08baa6a v0.32 2024-04-14T11:06:34.799 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.32 2024-04-14T11:06:34.854 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:34.854 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 33 -eq 48 ']' 2024-04-14T11:06:34.854 INFO:tasks.workunit.client.0.smithi084.stdout:v0.33 2024-04-14T11:06:34.854 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.33 2024-04-14T11:06:34.855 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.33 2024-04-14T11:06:34.855 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.33 2024-04-14T11:06:36.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:06:36.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:06:36.352 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 340b4348bf6 v0.33 2024-04-14T11:06:36.354 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.33 2024-04-14T11:06:36.462 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:36.462 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 34 -eq 48 ']' 2024-04-14T11:06:36.462 INFO:tasks.workunit.client.0.smithi084.stdout:v0.34 2024-04-14T11:06:36.462 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.34 2024-04-14T11:06:36.463 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.34 2024-04-14T11:06:36.463 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.34 2024-04-14T11:06:37.862 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 2f039eeeb74 v0.34 2024-04-14T11:06:37.864 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.34 2024-04-14T11:06:37.897 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:37.897 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 35 -eq 48 ']' 2024-04-14T11:06:37.897 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.35 2024-04-14T11:06:37.897 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.35 2024-04-14T11:06:37.898 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.35 2024-04-14T11:06:37.898 INFO:tasks.workunit.client.0.smithi084.stdout:v0.35 2024-04-14T11:06:39.872 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 65% (219/334) Updating files: 66% (221/334) Updating files: 67% (224/334) Updating files: 68% (228/334) Updating files: 69% (231/334) Updating files: 70% (234/334) Updating files: 71% (238/334) Updating files: 72% (241/334) Updating files: 73% (244/334) Updating files: 74% (248/334) Updating files: 75% (251/334) Updating files: 76% (254/334) Updating files: 77% (258/334) Updating files: 78% (261/334) Updating files: 79% (264/334) Updating files: 80% (268/334) Updating files: 81% (271/334) Updating files: 82% (274/334) Updating files: 83% (278/334) Updating files: 84% (281/334) Updating files: 85% (284/334) Updating files: 86% (288/334) Updating files: 87% (291/334) Updating files: 88% (294/334) Updating files: 89% (298/334) Updating files: 90% (301/334) Updating files: 91% (304/334) Updating files: 92% (308/334) Updating files: 93% (311/334) Updating files: 94% (314/334) Updating files: 95% (318/334) Updating files: 96% (321/334) Updating files: 97% (324/334) Updating files: 98% (328/334) Updating files: 99% (331/334) Updating files: 100% (334/334) Updating files: 100% (334/334), done. 2024-04-14T11:06:39.987 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 0afda378124 v0.35 2024-04-14T11:06:39.989 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.35 2024-04-14T11:06:40.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:40.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 36 -eq 48 ']' 2024-04-14T11:06:40.026 INFO:tasks.workunit.client.0.smithi084.stdout:v0.36 2024-04-14T11:06:40.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.36 2024-04-14T11:06:40.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.36 2024-04-14T11:06:40.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.36 2024-04-14T11:06:41.659 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 96% (236/244) Updating files: 97% (237/244) Updating files: 98% (240/244) Updating files: 99% (242/244) Updating files: 100% (244/244) Updating files: 100% (244/244), done. 2024-04-14T11:06:41.973 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 877cacbbdbb v0.36 2024-04-14T11:06:41.975 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.36 2024-04-14T11:06:42.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:42.025 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 37 -eq 48 ']' 2024-04-14T11:06:42.025 INFO:tasks.workunit.client.0.smithi084.stdout:v0.37 2024-04-14T11:06:42.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.37 2024-04-14T11:06:42.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.37 2024-04-14T11:06:42.026 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.37 2024-04-14T11:06:43.724 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at a6f3bbb744a v0.37 2024-04-14T11:06:43.725 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.37 2024-04-14T11:06:43.766 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:43.766 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 38 -eq 48 ']' 2024-04-14T11:06:43.766 INFO:tasks.workunit.client.0.smithi084.stdout:v0.38 2024-04-14T11:06:43.767 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.38 2024-04-14T11:06:43.767 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.38 2024-04-14T11:06:43.767 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.38 2024-04-14T11:06:45.277 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at b600ec2ac7c v0.38 2024-04-14T11:06:45.278 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.38 2024-04-14T11:06:45.346 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:45.346 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 39 -eq 48 ']' 2024-04-14T11:06:45.346 INFO:tasks.workunit.client.0.smithi084.stdout:v0.39 2024-04-14T11:06:45.347 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.39 2024-04-14T11:06:45.347 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.39 2024-04-14T11:06:45.347 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.39 2024-04-14T11:06:47.187 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 74% (192/258) Updating files: 75% (194/258) Updating files: 76% (197/258) Updating files: 77% (199/258) Updating files: 78% (202/258) Updating files: 79% (204/258) Updating files: 80% (207/258) Updating files: 81% (209/258) Updating files: 82% (212/258) Updating files: 83% (215/258) Updating files: 84% (217/258) Updating files: 85% (220/258) Updating files: 86% (222/258) Updating files: 87% (225/258) Updating files: 88% (228/258) Updating files: 89% (230/258) Updating files: 90% (233/258) Updating files: 91% (235/258) Updating files: 92% (238/258) Updating files: 93% (240/258) Updating files: 94% (243/258) Updating files: 95% (246/258) Updating files: 96% (248/258) Updating files: 97% (251/258) Updating files: 98% (253/258) Updating files: 99% (256/258) Updating files: 100% (258/258) Updating files: 100% (258/258), done. 2024-04-14T11:06:47.249 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 321ecdaba2c v0.39 2024-04-14T11:06:47.251 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.39 2024-04-14T11:06:47.364 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:47.364 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 40 -eq 48 ']' 2024-04-14T11:06:47.364 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.40 2024-04-14T11:06:47.364 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.40 2024-04-14T11:06:47.364 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.40 2024-04-14T11:06:47.364 INFO:tasks.workunit.client.0.smithi084.stdout:v0.40 2024-04-14T11:06:49.077 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 84% (191/226) Updating files: 85% (193/226) Updating files: 86% (195/226) Updating files: 87% (197/226) Updating files: 88% (199/226) Updating files: 89% (202/226) Updating files: 90% (204/226) Updating files: 91% (206/226) Updating files: 92% (208/226) Updating files: 93% (211/226) Updating files: 94% (213/226) Updating files: 95% (215/226) Updating files: 96% (217/226) Updating files: 97% (220/226) Updating files: 98% (222/226) Updating files: 99% (224/226) Updating files: 100% (226/226) Updating files: 100% (226/226), done. 2024-04-14T11:06:49.150 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 7eea40ea37f v0.40 2024-04-14T11:06:49.152 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.40 2024-04-14T11:06:49.337 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:49.338 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 41 -eq 48 ']' 2024-04-14T11:06:49.338 INFO:tasks.workunit.client.0.smithi084.stdout:v0.41 2024-04-14T11:06:49.338 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.41 2024-04-14T11:06:49.338 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.41 2024-04-14T11:06:49.339 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.41 2024-04-14T11:06:50.463 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at c1345f7136a v0.41 2024-04-14T11:06:50.464 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.41 2024-04-14T11:06:50.583 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:50.584 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 42 -eq 48 ']' 2024-04-14T11:06:50.584 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.42 2024-04-14T11:06:50.584 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.42 2024-04-14T11:06:50.584 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.42 2024-04-14T11:06:50.584 INFO:tasks.workunit.client.0.smithi084.stdout:v0.42 2024-04-14T11:06:52.484 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 73% (183/250) Updating files: 74% (185/250) Updating files: 75% (188/250) Updating files: 76% (190/250) Updating files: 77% (193/250) Updating files: 78% (195/250) Updating files: 79% (198/250) Updating files: 80% (200/250) Updating files: 81% (203/250) Updating files: 82% (205/250) Updating files: 83% (208/250) Updating files: 84% (210/250) Updating files: 85% (213/250) Updating files: 86% (215/250) Updating files: 87% (218/250) Updating files: 88% (220/250) Updating files: 89% (223/250) Updating files: 90% (225/250) Updating files: 91% (228/250) Updating files: 92% (230/250) Updating files: 93% (233/250) Updating files: 94% (235/250) Updating files: 95% (238/250) Updating files: 96% (240/250) Updating files: 97% (243/250) Updating files: 98% (245/250) Updating files: 99% (248/250) Updating files: 100% (250/250) Updating files: 100% (250/250), done. 2024-04-14T11:06:52.570 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at b205c64c687 v0.42 2024-04-14T11:06:52.571 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.42 2024-04-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 43 -eq 48 ']' 2024-04-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi084.stdout:v0.43 2024-04-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.43 2024-04-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.43 2024-04-14T11:06:52.679 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.43 2024-04-14T11:06:53.983 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 9fa8781c014 v0.43 2024-04-14T11:06:53.984 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.43 2024-04-14T11:06:54.056 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:54.056 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 44 -eq 48 ']' 2024-04-14T11:06:54.056 INFO:tasks.workunit.client.0.smithi084.stdout:v0.44 2024-04-14T11:06:54.057 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.44 2024-04-14T11:06:54.057 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.44 2024-04-14T11:06:54.057 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.44 2024-04-14T11:06:55.736 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at cdd5298d276 v0.44 2024-04-14T11:06:55.739 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.44 2024-04-14T11:06:55.798 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:55.798 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 45 -eq 48 ']' 2024-04-14T11:06:55.799 INFO:tasks.workunit.client.0.smithi084.stdout:v0.45 2024-04-14T11:06:55.799 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.45 2024-04-14T11:06:55.799 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.45 2024-04-14T11:06:55.799 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.45 2024-04-14T11:06:57.303 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 0aea1cb1df5 v0.45 2024-04-14T11:06:57.304 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.45 2024-04-14T11:06:57.392 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:57.392 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 46 -eq 48 ']' 2024-04-14T11:06:57.392 INFO:tasks.workunit.client.0.smithi084.stdout:v0.46 2024-04-14T11:06:57.392 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.46 2024-04-14T11:06:57.393 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.46 2024-04-14T11:06:57.393 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.46 2024-04-14T11:06:59.472 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 64% (200/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-04-14T11:06:59.537 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at cb7f1c9c752 v0.46 2024-04-14T11:06:59.538 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.46 2024-04-14T11:06:59.592 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:06:59.592 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 47 -eq 48 ']' 2024-04-14T11:06:59.593 INFO:tasks.workunit.client.0.smithi084.stdout:v0.47 2024-04-14T11:06:59.593 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.47 2024-04-14T11:06:59.593 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.47 2024-04-14T11:06:59.593 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.47 2024-04-14T11:07:01.312 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 91% (201/219) Updating files: 92% (202/219) Updating files: 93% (204/219) Updating files: 94% (206/219) Updating files: 95% (209/219) Updating files: 96% (211/219) Updating files: 97% (213/219) Updating files: 98% (215/219) Updating files: 99% (217/219) Updating files: 100% (219/219) Updating files: 100% (219/219), done. 2024-04-14T11:07:01.465 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at ad663d58c89 v0.47 2024-04-14T11:07:01.466 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.47 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 48 -eq 48 ']' 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ continue 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 49 -eq 48 ']' 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.49 2024-04-14T11:07:01.627 INFO:tasks.workunit.client.0.smithi084.stdout:v0.49 2024-04-14T11:07:01.628 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.49 2024-04-14T11:07:01.628 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.49 2024-04-14T11:07:04.615 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 50% (241/481) Updating files: 51% (246/481) Updating files: 52% (251/481) Updating files: 53% (255/481) Updating files: 54% (260/481) Updating files: 55% (265/481) Updating files: 56% (270/481) Updating files: 57% (275/481) Updating files: 58% (279/481) Updating files: 59% (284/481) Updating files: 60% (289/481) Updating files: 61% (294/481) Updating files: 62% (299/481) Updating files: 63% (304/481) Updating files: 64% (308/481) Updating files: 65% (313/481) Updating files: 66% (318/481) Updating files: 67% (323/481) Updating files: 68% (328/481) Updating files: 69% (332/481) Updating files: 70% (337/481) Updating files: 71% (342/481) Updating files: 72% (347/481) Updating files: 73% (352/481) Updating files: 74% (356/481) Updating files: 75% (361/481) Updating files: 76% (366/481) Updating files: 77% (371/481) Updating files: 78% (376/481) Updating files: 79% (380/481) Updating files: 80% (385/481) Updating files: 81% (390/481) Updating files: 82% (395/481) Updating files: 82% (396/481) Updating files: 83% (400/481) Updating files: 84% (405/481) Updating files: 85% (409/481) Updating files: 86% (414/481) Updating files: 87% (419/481) Updating files: 88% (424/481) Updating files: 89% (429/481) Updating files: 90% (433/481) Updating files: 91% (438/481) Updating files: 92% (443/481) Updating files: 93% (448/481) Updating files: 94% (453/481) Updating files: 95% (457/481) Updating files: 96% (462/481) Updating files: 97% (467/481) Updating files: 98% (472/481) Updating files: 99% (477/481) Updating files: 100% (481/481) Updating files: 100% (481/481), done. 2024-04-14T11:07:04.684 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at ca6265d0f4d v0.49 2024-04-14T11:07:04.686 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.49 2024-04-14T11:07:04.837 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:04.837 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 50 -eq 48 ']' 2024-04-14T11:07:04.837 INFO:tasks.workunit.client.0.smithi084.stdout:v0.50 2024-04-14T11:07:04.838 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.50 2024-04-14T11:07:04.838 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.50 2024-04-14T11:07:04.838 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.50 2024-04-14T11:07:06.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:07:06.244 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:07:06.288 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-14T11:07:06.298+0000 7fe1299f9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44081) UID: 0 2024-04-14T11:07:06.289 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-04-14T11:07:06.298+0000 7fe160bf9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44081) UID: 0 2024-04-14T11:07:06.289 INFO:tasks.ceph.mds.f.smithi175.stderr:2024-04-14T11:07:06.298+0000 7fe73dbf9640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44081) UID: 0 2024-04-14T11:07:06.489 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at a4428bd0e19 v0.50 2024-04-14T11:07:06.490 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.50 2024-04-14T11:07:06.599 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:06.599 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 51 -eq 48 ']' 2024-04-14T11:07:06.600 INFO:tasks.workunit.client.0.smithi084.stdout:v0.51 2024-04-14T11:07:06.600 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.51 2024-04-14T11:07:06.600 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.51 2024-04-14T11:07:06.600 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.51 2024-04-14T11:07:08.066 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at c03ca95d235 v0.51 2024-04-14T11:07:08.068 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.51 2024-04-14T11:07:08.117 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:08.118 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 52 -eq 48 ']' 2024-04-14T11:07:08.118 INFO:tasks.workunit.client.0.smithi084.stdout:v0.52 2024-04-14T11:07:08.118 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.52 2024-04-14T11:07:08.118 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.52 2024-04-14T11:07:08.119 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.52 2024-04-14T11:07:09.921 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 89% (163/183) Updating files: 90% (165/183) Updating files: 91% (167/183) Updating files: 92% (169/183) Updating files: 93% (171/183) Updating files: 94% (173/183) Updating files: 95% (174/183) Updating files: 96% (176/183) Updating files: 97% (178/183) Updating files: 98% (180/183) Updating files: 99% (182/183) Updating files: 100% (183/183) Updating files: 100% (183/183), done. 2024-04-14T11:07:09.964 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at e48859474c4 v0.52 2024-04-14T11:07:09.966 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.52 2024-04-14T11:07:10.029 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:10.029 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 53 -eq 48 ']' 2024-04-14T11:07:10.029 INFO:tasks.workunit.client.0.smithi084.stdout:v0.53 2024-04-14T11:07:10.029 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.53 2024-04-14T11:07:10.029 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.53 2024-04-14T11:07:10.029 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.53 2024-04-14T11:07:12.532 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 60% (234/386) Updating files: 61% (236/386) Updating files: 62% (240/386) Updating files: 63% (244/386) Updating files: 64% (248/386) Updating files: 65% (251/386) Updating files: 66% (255/386) Updating files: 67% (259/386) Updating files: 68% (263/386) Updating files: 69% (267/386) Updating files: 70% (271/386) Updating files: 71% (275/386) Updating files: 72% (278/386) Updating files: 73% (282/386) Updating files: 74% (286/386) Updating files: 75% (290/386) Updating files: 76% (294/386) Updating files: 77% (298/386) Updating files: 78% (302/386) Updating files: 79% (305/386) Updating files: 80% (309/386) Updating files: 81% (313/386) Updating files: 82% (317/386) Updating files: 83% (321/386) Updating files: 84% (325/386) Updating files: 85% (329/386) Updating files: 86% (332/386) Updating files: 87% (336/386) Updating files: 88% (340/386) Updating files: 89% (344/386) Updating files: 90% (348/386) Updating files: 91% (352/386) Updating files: 92% (356/386) Updating files: 93% (359/386) Updating files: 94% (363/386) Updating files: 95% (367/386) Updating files: 96% (371/386) Updating files: 97% (375/386) Updating files: 98% (379/386) Updating files: 99% (383/386) Updating files: 100% (386/386) Updating files: 100% (386/386), done. 2024-04-14T11:07:12.741 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 2528b5ee105 v0.43 2024-04-14T11:07:12.743 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.53 2024-04-14T11:07:12.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:12.797 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 54 -eq 48 ']' 2024-04-14T11:07:12.798 INFO:tasks.workunit.client.0.smithi084.stdout:v0.54 2024-04-14T11:07:12.798 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.54 2024-04-14T11:07:12.798 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.54 2024-04-14T11:07:12.798 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.54 2024-04-14T11:07:14.773 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 79% (169/212) Updating files: 80% (170/212) Updating files: 81% (172/212) Updating files: 82% (174/212) Updating files: 83% (176/212) Updating files: 84% (179/212) Updating files: 85% (181/212) Updating files: 86% (183/212) Updating files: 87% (185/212) Updating files: 88% (187/212) Updating files: 89% (189/212) Updating files: 90% (191/212) Updating files: 91% (193/212) Updating files: 92% (196/212) Updating files: 93% (198/212) Updating files: 94% (200/212) Updating files: 95% (202/212) Updating files: 96% (204/212) Updating files: 97% (206/212) Updating files: 98% (208/212) Updating files: 99% (210/212) Updating files: 100% (212/212) Updating files: 100% (212/212), done. 2024-04-14T11:07:14.932 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 60b84b095b1 v0.54 2024-04-14T11:07:14.934 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.54 2024-04-14T11:07:14.983 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:14.983 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 55 -eq 48 ']' 2024-04-14T11:07:14.983 INFO:tasks.workunit.client.0.smithi084.stdout:v0.55 2024-04-14T11:07:14.984 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.55 2024-04-14T11:07:14.984 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.55 2024-04-14T11:07:14.984 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.55 2024-04-14T11:07:18.349 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 46% (253/540) Updating files: 47% (254/540) Updating files: 48% (260/540) Updating files: 49% (265/540) Updating files: 50% (270/540) Updating files: 51% (276/540) Updating files: 52% (281/540) Updating files: 53% (287/540) Updating files: 54% (292/540) Updating files: 55% (297/540) Updating files: 56% (303/540) Updating files: 57% (308/540) Updating files: 58% (314/540) Updating files: 59% (319/540) Updating files: 60% (324/540) Updating files: 61% (330/540) Updating files: 62% (335/540) Updating files: 63% (341/540) Updating files: 64% (346/540) Updating files: 65% (351/540) Updating files: 66% (357/540) Updating files: 67% (362/540) Updating files: 68% (368/540) Updating files: 69% (373/540) Updating files: 70% (378/540) Updating files: 71% (384/540) Updating files: 72% (389/540) Updating files: 73% (395/540) Updating files: 74% (400/540) Updating files: 75% (405/540) Updating files: 76% (411/540) Updating files: 77% (416/540) Updating files: 78% (422/540) Updating files: 79% (427/540) Updating files: 80% (432/540) Updating files: 81% (438/540) Updating files: 82% (443/540) Updating files: 83% (449/540) Updating files: 84% (454/540) Updating files: 85% (459/540) Updating files: 86% (465/540) Updating files: 87% (470/540) Updating files: 88% (476/540) Updating files: 89% (481/540) Updating files: 90% (486/540) Updating files: 91% (492/540) Updating files: 92% (497/540) Updating files: 93% (503/540) Updating files: 94% (508/540) Updating files: 95% (513/540) Updating files: 96% (519/540) Updating files: 97% (524/540) Updating files: 98% (530/540) Updating files: 99% (535/540) Updating files: 100% (540/540) Updating files: 100% (540/540), done. 2024-04-14T11:07:18.460 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 690f8175606 v0.55 2024-04-14T11:07:18.463 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.55 2024-04-14T11:07:18.580 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:18.580 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 56 -eq 48 ']' 2024-04-14T11:07:18.580 INFO:tasks.workunit.client.0.smithi084.stdout:v0.56 2024-04-14T11:07:18.581 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.56 2024-04-14T11:07:18.581 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.56 2024-04-14T11:07:18.581 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.56 2024-04-14T11:07:20.856 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 75% (186/246) Updating files: 76% (187/246) Updating files: 77% (190/246) Updating files: 78% (192/246) Updating files: 79% (195/246) Updating files: 80% (197/246) Updating files: 81% (200/246) Updating files: 82% (202/246) Updating files: 83% (205/246) Updating files: 84% (207/246) Updating files: 85% (210/246) Updating files: 86% (212/246) Updating files: 87% (215/246) Updating files: 88% (217/246) Updating files: 89% (219/246) Updating files: 90% (222/246) Updating files: 91% (224/246) Updating files: 92% (227/246) Updating files: 93% (229/246) Updating files: 94% (232/246) Updating files: 95% (234/246) Updating files: 96% (237/246) Updating files: 97% (239/246) Updating files: 98% (242/246) Updating files: 99% (244/246) Updating files: 100% (246/246) Updating files: 100% (246/246), done. 2024-04-14T11:07:21.008 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 1a32f0a0b42 v0.56 2024-04-14T11:07:21.011 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.56 2024-04-14T11:07:21.065 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:21.065 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 57 -eq 48 ']' 2024-04-14T11:07:21.066 INFO:tasks.workunit.client.0.smithi084.stdout:v0.57 2024-04-14T11:07:21.066 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.57 2024-04-14T11:07:21.066 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.57 2024-04-14T11:07:21.066 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.57 2024-04-14T11:07:23.615 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 58% (177/304) Updating files: 59% (180/304) Updating files: 60% (183/304) Updating files: 61% (186/304) Updating files: 62% (189/304) Updating files: 63% (192/304) Updating files: 64% (195/304) Updating files: 65% (198/304) Updating files: 66% (201/304) Updating files: 67% (204/304) Updating files: 68% (207/304) Updating files: 69% (210/304) Updating files: 70% (213/304) Updating files: 71% (216/304) Updating files: 72% (219/304) Updating files: 73% (222/304) Updating files: 74% (225/304) Updating files: 75% (228/304) Updating files: 76% (232/304) Updating files: 77% (235/304) Updating files: 78% (238/304) Updating files: 79% (241/304) Updating files: 80% (244/304) Updating files: 81% (247/304) Updating files: 82% (250/304) Updating files: 83% (253/304) Updating files: 84% (256/304) Updating files: 85% (259/304) Updating files: 86% (262/304) Updating files: 87% (265/304) Updating files: 88% (268/304) Updating files: 89% (271/304) Updating files: 90% (274/304) Updating files: 91% (277/304) Updating files: 92% (280/304) Updating files: 93% (283/304) Updating files: 94% (286/304) Updating files: 95% (289/304) Updating files: 96% (292/304) Updating files: 97% (295/304) Updating files: 98% (298/304) Updating files: 99% (301/304) Updating files: 100% (304/304) Updating files: 100% (304/304), done. 2024-04-14T11:07:23.746 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 9a7a9d06c06 v0.57 2024-04-14T11:07:23.749 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.57 2024-04-14T11:07:23.885 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:23.886 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 58 -eq 48 ']' 2024-04-14T11:07:23.886 INFO:tasks.workunit.client.0.smithi084.stdout:v0.58 2024-04-14T11:07:23.886 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.58 2024-04-14T11:07:23.886 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.58 2024-04-14T11:07:23.886 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.58 2024-04-14T11:07:26.225 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 60% (161/268) Updating files: 61% (164/268) Updating files: 62% (167/268) Updating files: 63% (169/268) Updating files: 64% (172/268) Updating files: 65% (175/268) Updating files: 66% (177/268) Updating files: 67% (180/268) Updating files: 68% (183/268) Updating files: 69% (185/268) Updating files: 70% (188/268) Updating files: 71% (191/268) Updating files: 72% (193/268) Updating files: 73% (196/268) Updating files: 74% (199/268) Updating files: 75% (201/268) Updating files: 76% (204/268) Updating files: 77% (207/268) Updating files: 78% (210/268) Updating files: 79% (212/268) Updating files: 80% (215/268) Updating files: 81% (218/268) Updating files: 82% (220/268) Updating files: 83% (223/268) Updating files: 84% (226/268) Updating files: 85% (228/268) Updating files: 86% (231/268) Updating files: 87% (234/268) Updating files: 88% (236/268) Updating files: 89% (239/268) Updating files: 90% (242/268) Updating files: 91% (244/268) Updating files: 92% (247/268) Updating files: 93% (250/268) Updating files: 94% (252/268) Updating files: 95% (255/268) Updating files: 96% (258/268) Updating files: 97% (260/268) Updating files: 98% (263/268) Updating files: 99% (266/268) Updating files: 100% (268/268) Updating files: 100% (268/268), done. 2024-04-14T11:07:26.365 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at ba3f91e7504 v0.58 2024-04-14T11:07:26.368 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.58 2024-04-14T11:07:26.419 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:26.419 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 59 -eq 48 ']' 2024-04-14T11:07:26.419 INFO:tasks.workunit.client.0.smithi084.stdout:v0.59 2024-04-14T11:07:26.419 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.59 2024-04-14T11:07:26.419 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.59 2024-04-14T11:07:26.420 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.59 2024-04-14T11:07:28.496 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 73% (155/211) Updating files: 74% (157/211) Updating files: 75% (159/211) Updating files: 76% (161/211) Updating files: 77% (163/211) Updating files: 78% (165/211) Updating files: 79% (167/211) Updating files: 80% (169/211) Updating files: 81% (171/211) Updating files: 82% (174/211) Updating files: 83% (176/211) Updating files: 84% (178/211) Updating files: 85% (180/211) Updating files: 86% (182/211) Updating files: 87% (184/211) Updating files: 88% (186/211) Updating files: 89% (188/211) Updating files: 90% (190/211) Updating files: 91% (193/211) Updating files: 92% (195/211) Updating files: 93% (197/211) Updating files: 94% (199/211) Updating files: 95% (201/211) Updating files: 96% (203/211) Updating files: 97% (205/211) Updating files: 98% (207/211) Updating files: 99% (209/211) Updating files: 100% (211/211) Updating files: 100% (211/211), done. 2024-04-14T11:07:28.591 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at cbae6a435c6 v0.59 2024-04-14T11:07:28.593 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.59 2024-04-14T11:07:28.712 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:28.712 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 60 -eq 48 ']' 2024-04-14T11:07:28.713 INFO:tasks.workunit.client.0.smithi084.stdout:v0.60 2024-04-14T11:07:28.713 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.60 2024-04-14T11:07:28.713 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.60 2024-04-14T11:07:28.713 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.60 2024-04-14T11:07:31.043 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 64% (166/256) Updating files: 65% (167/256) Updating files: 66% (169/256) Updating files: 67% (172/256) Updating files: 68% (175/256) Updating files: 69% (177/256) Updating files: 70% (180/256) Updating files: 71% (182/256) Updating files: 72% (185/256) Updating files: 73% (187/256) Updating files: 74% (190/256) Updating files: 75% (192/256) Updating files: 76% (195/256) Updating files: 77% (198/256) Updating files: 78% (200/256) Updating files: 79% (203/256) Updating files: 80% (205/256) Updating files: 81% (208/256) Updating files: 82% (210/256) Updating files: 83% (213/256) Updating files: 84% (216/256) Updating files: 85% (218/256) Updating files: 86% (221/256) Updating files: 87% (223/256) Updating files: 88% (226/256) Updating files: 89% (228/256) Updating files: 90% (231/256) Updating files: 91% (233/256) Updating files: 92% (236/256) Updating files: 93% (239/256) Updating files: 94% (241/256) Updating files: 95% (244/256) Updating files: 96% (246/256) Updating files: 97% (249/256) Updating files: 98% (251/256) Updating files: 99% (254/256) Updating files: 100% (256/256) Updating files: 100% (256/256), done. 2024-04-14T11:07:31.133 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at f26f7a39021 v0.60 2024-04-14T11:07:31.136 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.60 2024-04-14T11:07:31.273 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:31.273 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 61 -eq 48 ']' 2024-04-14T11:07:31.274 INFO:tasks.workunit.client.0.smithi084.stdout:v0.61 2024-04-14T11:07:31.274 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.61 2024-04-14T11:07:31.274 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.61 2024-04-14T11:07:31.274 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.61 2024-04-14T11:07:34.079 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 51% (192/376) Updating files: 52% (196/376) Updating files: 53% (200/376) Updating files: 54% (204/376) Updating files: 55% (207/376) Updating files: 56% (211/376) Updating files: 57% (215/376) Updating files: 58% (219/376) Updating files: 59% (222/376) Updating files: 60% (226/376) Updating files: 61% (230/376) Updating files: 62% (234/376) Updating files: 63% (237/376) Updating files: 64% (241/376) Updating files: 65% (245/376) Updating files: 66% (249/376) Updating files: 67% (252/376) Updating files: 68% (256/376) Updating files: 69% (260/376) Updating files: 70% (264/376) Updating files: 71% (267/376) Updating files: 72% (271/376) Updating files: 73% (275/376) Updating files: 74% (279/376) Updating files: 75% (282/376) Updating files: 76% (286/376) Updating files: 77% (290/376) Updating files: 78% (294/376) Updating files: 79% (298/376) Updating files: 80% (301/376) Updating files: 81% (305/376) Updating files: 82% (309/376) Updating files: 83% (313/376) Updating files: 84% (316/376) Updating files: 85% (320/376) Updating files: 86% (324/376) Updating files: 87% (328/376) Updating files: 88% (331/376) Updating files: 89% (335/376) Updating files: 90% (339/376) Updating files: 91% (343/376) Updating files: 92% (346/376) Updating files: 93% (350/376) Updating files: 93% (351/376) Updating files: 94% (354/376) Updating files: 95% (358/376) Updating files: 96% (361/376) Updating files: 97% (365/376) Updating files: 98% (369/376) Updating files: 99% (373/376) Updating files: 100% (376/376) Updating files: 100% (376/376), done. 2024-04-14T11:07:34.133 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 237f3f1e8d8 v0.61 2024-04-14T11:07:34.137 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.61 2024-04-14T11:07:34.229 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:34.229 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 62 -eq 48 ']' 2024-04-14T11:07:34.229 INFO:tasks.workunit.client.0.smithi084.stdout:v0.62 2024-04-14T11:07:34.230 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.62 2024-04-14T11:07:34.230 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.62 2024-04-14T11:07:34.230 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.62 2024-04-14T11:07:35.561 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 9382379cc6b v0.62 2024-04-14T11:07:35.562 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.62 2024-04-14T11:07:35.657 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:07:35.657 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 63 -eq 48 ']' 2024-04-14T11:07:35.658 INFO:tasks.workunit.client.0.smithi084.stdout:v0.63 2024-04-14T11:07:35.658 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.63 2024-04-14T11:07:35.658 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.63 2024-04-14T11:07:35.658 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.63 2024-04-14T11:07:35.797 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0),will split into two consecutive quiesces 2024-04-14T11:07:35.797 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-14T11:07:35.798 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T11:07:35.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.918+0000 7ff2f80c8640 1 Processor -- start 2024-04-14T11:07:35.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.918+0000 7ff2f80c8640 1 -- start start 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f80c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f00c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f80c8640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2f0072830 0x7ff2f0072c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f80c8640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f006eb80 con 0x7ff2f015b350 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f80c8640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f00c37d0 con 0x7ff2f0072830 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f80c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00c3a90 con 0x7ff2f015af70 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5663640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2f0072830 0x7ff2f0072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f6665640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff2f015b350 0x7ff2f015b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:46370/0 (socket says 172.21.15.84:46370) 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5663640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7ff2f0072830 0x7ff2f0072c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42612/0 (socket says 172.21.15.84:42612) 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f6665640 1 -- 172.21.15.84:0/396539308 learned_addr learned my addr 172.21.15.84:0/396539308 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5e64640 1 --2- 172.21.15.84:0/396539308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f00c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5663640 1 -- 172.21.15.84:0/396539308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 msgr2=0x7ff2f00c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5663640 1 --2- 172.21.15.84:0/396539308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f00c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5663640 1 -- 172.21.15.84:0/396539308 >> v1:172.21.15.84:6789/0 conn(0x7ff2f015b350 legacy=0x7ff2f015b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:35.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f4e62640 1 -- 172.21.15.84:0/396539308 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 346030644 0 0) 0x7ff2e8001490 con 0x7ff2f015b350 2024-04-14T11:07:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.919+0000 7ff2f5663640 1 -- 172.21.15.84:0/396539308 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f00c3d70 con 0x7ff2f0072830 2024-04-14T11:07:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.920+0000 7ff2f5663640 1 --2- 172.21.15.84:0/396539308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0072c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00097a0 tx=0x7ff2e002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523d0e840415191c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.920+0000 7ff2f4e62640 1 -- 172.21.15.84:0/396539308 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0034070 con 0x7ff2f0072830 2024-04-14T11:07:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.920+0000 7ff2f4e62640 1 -- 172.21.15.84:0/396539308 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e0030610 con 0x7ff2f0072830 2024-04-14T11:07:35.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.920+0000 7ff2f4e62640 1 -- 172.21.15.84:0/396539308 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00309e0 con 0x7ff2f0072830 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 -- 172.21.15.84:0/396539308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 msgr2=0x7ff2f0072c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/396539308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0072c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00097a0 tx=0x7ff2e002b960 comp rx=0 tx=0).stop 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 -- 172.21.15.84:0/396539308 shutdown_connections 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/396539308 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0072c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/396539308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f00c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 -- 172.21.15.84:0/396539308 >> 172.21.15.84:0/396539308 conn(0x7ff2f00cc150 msgr2=0x7ff2f00cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 -- 172.21.15.84:0/396539308 shutdown_connections 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.921+0000 7ff2f80c8640 1 -- 172.21.15.84:0/396539308 wait complete. 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.922+0000 7ff2f80c8640 1 Processor -- start 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.922+0000 7ff2f80c8640 1 -- start start 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f0163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f015b350 0x7ff2f00cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:35.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00c6480 con 0x7ff2f0072830 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00c61a0 con 0x7ff2f015b350 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f0073190 con 0x7ff2f015af70 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42628/0 (socket says 172.21.15.84:42628) 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 -- 172.21.15.84:0/1731535196 learned_addr learned my addr 172.21.15.84:0/1731535196 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5663640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f0163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f6665640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f015b350 0x7ff2f00cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 -- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 msgr2=0x7ff2f0163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f0163890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 -- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f015b350 msgr2=0x7ff2f00cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f015b350 0x7ff2f00cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 -- 172.21.15.84:0/1731535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f01633b0 con 0x7ff2f0072830 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f5e64640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0141790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00e9b0 tx=0x7ff2ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec017070 con 0x7ff2f0072830 2024-04-14T11:07:35.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00c9a0 con 0x7ff2f0072830 2024-04-14T11:07:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f0164ff0 con 0x7ff2f0072830 2024-04-14T11:07:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec00cd90 con 0x7ff2f0072830 2024-04-14T11:07:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.923+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f014f870 con 0x7ff2f0072830 2024-04-14T11:07:35.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.924+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f0069c30 con 0x7ff2f0072830 2024-04-14T11:07:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.925+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2ec01a070 con 0x7ff2f0072830 2024-04-14T11:07:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.925+0000 7ff2e67fc640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d406c8f0 0x7ff2d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.925+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7ff2ec08bba0 con 0x7ff2f0072830 2024-04-14T11:07:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.925+0000 7ff2f5663640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d406c8f0 0x7ff2d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:35.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.926+0000 7ff2f5663640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d406c8f0 0x7ff2d406edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0036000 tx=0x7ff2e003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:35.930+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff2ec059890 con 0x7ff2f0072830 2024-04-14T11:07:36.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.181+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2f01435d0 con 0x7ff2f0072830 2024-04-14T11:07:36.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.182+0000 7ff2e67fc640 1 -- 172.21.15.84:0/1731535196 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7ff2ec05db90 con 0x7ff2f0072830 2024-04-14T11:07:36.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:07:36.173 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T11:07:36.173 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d406c8f0 msgr2=0x7ff2d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d406c8f0 0x7ff2d406edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0036000 tx=0x7ff2e003b040 comp rx=0 tx=0).stop 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 msgr2=0x7ff2f0141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0141790 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00e9b0 tx=0x7ff2ec00ee70 comp rx=0 tx=0).stop 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 shutdown_connections 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff2d406c8f0 0x7ff2d406edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2f015b350 0x7ff2f00cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2f015af70 0x7ff2f0163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 --2- 172.21.15.84:0/1731535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2f0072830 0x7ff2f0141790 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 >> 172.21.15.84:0/1731535196 conn(0x7ff2f00cc150 msgr2=0x7ff2f00c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:07:36.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 shutdown_connections 2024-04-14T11:07:36.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.184+0000 7ff2f80c8640 1 -- 172.21.15.84:0/1731535196 wait complete. 2024-04-14T11:07:36.186 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4308 quiesce db / --timeout 30 --expiration 90.0 --await' 2024-04-14T11:07:36.186 DEBUG:teuthology.orchestra.run.smithi084:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4308 quiesce db / --timeout 30 --expiration 90.0 --await 2024-04-14T11:07:36.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.311+0000 7fadc5ddc640 1 Processor -- start 2024-04-14T11:07:36.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadc5ddc640 1 -- start start 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadc5ddc640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadc0154e10 0x7fadc00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadc5ddc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fadc00c57b0 0x7fadc015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadc5ddc640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc015eca0 con 0x7fadc015e730 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadc5ddc640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fadc00cca40 con 0x7fadc0154e10 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadc5ddc640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fadc00cd2e0 con 0x7fadc00c57b0 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.312+0000 7fadbf7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadc0154e10 0x7fadc00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbf7fe640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fadc0154e10 0x7fadc00cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42644/0 (socket says 172.21.15.84:42644) 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbf7fe640 1 -- 172.21.15.84:0/3979370000 learned_addr learned my addr 172.21.15.84:0/3979370000 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:36.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbeffd640 1 --2- 172.21.15.84:0/3979370000 >> v2:172.21.15.175:3300/0 conn(0x7fadc00c57b0 0x7fadc015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbf7fe640 1 -- 172.21.15.84:0/3979370000 >> v2:172.21.15.175:3300/0 conn(0x7fadc00c57b0 msgr2=0x7fadc015e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/3979370000 >> v2:172.21.15.175:3300/0 conn(0x7fadc00c57b0 0x7fadc015e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbf7fe640 1 -- 172.21.15.84:0/3979370000 >> v1:172.21.15.84:6789/0 conn(0x7fadc015e730 legacy=0x7fadc00d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbf7fe640 1 -- 172.21.15.84:0/3979370000 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc015ef80 con 0x7fadc0154e10 2024-04-14T11:07:36.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.313+0000 7fadbe7fc640 1 -- 172.21.15.84:0/3979370000 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905640182 0 0) 0x7fadc015eca0 con 0x7fadc015e730 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.314+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/3979370000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc0154e10 0x7fadc00cd770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fadc0073490 tx=0x7fadb002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb8288767fa7673 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.314+0000 7fadbe7fc640 1 -- 172.21.15.84:0/3979370000 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0034070 con 0x7fadc0154e10 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.314+0000 7fadbe7fc640 1 -- 172.21.15.84:0/3979370000 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb0030860 con 0x7fadc0154e10 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.314+0000 7fadbe7fc640 1 -- 172.21.15.84:0/3979370000 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0030c30 con 0x7fadc0154e10 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.314+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3979370000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc0154e10 msgr2=0x7fadc00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.314+0000 7fadc5ddc640 1 --2- 172.21.15.84:0/3979370000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc0154e10 0x7fadc00cd770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fadc0073490 tx=0x7fadb002b9a0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.315+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3979370000 shutdown_connections 2024-04-14T11:07:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.315+0000 7fadc5ddc640 1 --2- 172.21.15.84:0/3979370000 >> v2:172.21.15.175:3300/0 conn(0x7fadc00c57b0 0x7fadc015e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.315+0000 7fadc5ddc640 1 --2- 172.21.15.84:0/3979370000 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc0154e10 0x7fadc00cd770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.315+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3979370000 >> 172.21.15.84:0/3979370000 conn(0x7fadc0072340 msgr2=0x7fadc006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:07:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.315+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3979370000 shutdown_connections 2024-04-14T11:07:36.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.315+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3979370000 wait complete. 2024-04-14T11:07:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.316+0000 7fadc5ddc640 1 Processor -- start 2024-04-14T11:07:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.316+0000 7fadc5ddc640 1 -- start start 2024-04-14T11:07:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadc5ddc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadc00c57b0 0x7fadc01e4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadc5ddc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc0154e10 0x7fadc01e6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadc5ddc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc015e730 0x7fadc01538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadc5ddc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00c5d00 con 0x7fadc015e730 2024-04-14T11:07:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadc5ddc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadc00ccf70 con 0x7fadc0154e10 2024-04-14T11:07:36.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadc5ddc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fadc015c7e0 con 0x7fadc00c57b0 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc015e730 0x7fadc01538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc015e730 0x7fadc01538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42652/0 (socket says 172.21.15.84:42652) 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 -- 172.21.15.84:0/3327215110 learned_addr learned my addr 172.21.15.84:0/3327215110 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbeffd640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc0154e10 0x7fadc01e6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadc00c57b0 0x7fadc01e4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 -- 172.21.15.84:0/3327215110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadc00c57b0 msgr2=0x7fadc01e4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fadc00c57b0 0x7fadc01e4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 -- 172.21.15.84:0/3327215110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc0154e10 msgr2=0x7fadc01e6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc0154e10 0x7fadc01e6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 -- 172.21.15.84:0/3327215110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc015ca80 con 0x7fadc015e730 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.317+0000 7fadbffff640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fadc015e730 0x7fadc01538f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c780 tx=0x7fadb800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.318+0000 7fada7fff640 1 -- 172.21.15.84:0/3327215110 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8003b70 con 0x7fadc015e730 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.318+0000 7fada7fff640 1 -- 172.21.15.84:0/3327215110 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb8003d10 con 0x7fadc015e730 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.318+0000 7fada7fff640 1 -- 172.21.15.84:0/3327215110 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8005270 con 0x7fadc015e730 2024-04-14T11:07:36.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.318+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3327215110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc015cd60 con 0x7fadc015e730 2024-04-14T11:07:36.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.318+0000 7fadc5ddc640 1 -- 172.21.15.84:0/3327215110 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc01e5880 con 0x7fadc015e730 2024-04-14T11:07:36.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.320+0000 7fada7fff640 1 -- 172.21.15.84:0/3327215110 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadb8005410 con 0x7fadc015e730 2024-04-14T11:07:36.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.320+0000 7fada7fff640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fadac06c920 0x7fadac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.320+0000 7fada7fff640 1 -- 172.21.15.84:0/3327215110 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fadb808b9a0 con 0x7fadc015e730 2024-04-14T11:07:36.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.320+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fadac06c920 0x7fadac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.321+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/3327215110 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fadac06c920 0x7fadac06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fadb0036000 tx=0x7fadb0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.321+0000 7fadc8bc4740 1 Processor -- start 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.321+0000 7fadc8bc4740 1 -- start start 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7d5630 0x55a3ec7d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7d5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d4090 0x55a3ec814e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a3ec73a040 con 0x55a3ec81f4b0 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a3ec6e0a70 con 0x55a3ec7d4090 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55a3ec736000 con 0x55a3ec7d5630 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7d5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7d5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42660/0 (socket says 172.21.15.84:42660) 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 -- 172.21.15.84:0/2410938749 learned_addr learned my addr 172.21.15.84:0/2410938749 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7d5630 0x55a3ec7d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbffff640 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d4090 0x55a3ec814e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 -- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7d5630 msgr2=0x55a3ec7d5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7d5630 0x55a3ec7d5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 -- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d4090 msgr2=0x55a3ec814e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d4090 0x55a3ec814e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.322+0000 7fadbeffd640 1 -- 172.21.15.84:0/2410938749 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ec518c90 con 0x55a3ec81f4b0 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.323+0000 7fadbeffd640 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7d5f50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009c10 tx=0x7fadb4011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f41d6a77a1c059 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.323+0000 7fada57fa640 1 -- 172.21.15.84:0/2410938749 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4019070 con 0x55a3ec81f4b0 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.323+0000 7fada57fa640 1 -- 172.21.15.84:0/2410938749 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb4004030 con 0x55a3ec81f4b0 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.323+0000 7fada57fa640 1 -- 172.21.15.84:0/2410938749 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4004420 con 0x55a3ec81f4b0 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.323+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2410938749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 msgr2=0x55a3ec7d5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.323+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7d5f50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009c10 tx=0x7fadb4011690 comp rx=0 tx=0).stop 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2410938749 shutdown_connections 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d4090 0x55a3ec814e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7d5f50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2410938749 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7d5630 0x55a3ec7d5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2410938749 >> 172.21.15.84:0/2410938749 conn(0x55a3ec7d1da0 msgr2=0x55a3ec7d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:07:36.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2410938749 shutdown_connections 2024-04-14T11:07:36.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2410938749 wait complete. 2024-04-14T11:07:36.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 -- start start 2024-04-14T11:07:36.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.324+0000 7fadc8bc4740 1 Processor -- start 2024-04-14T11:07:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec819140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec7fb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a3ec7fab90 con 0x55a3ec7d5630 2024-04-14T11:07:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55a3ec6f3e30 con 0x55a3ec81f4b0 2024-04-14T11:07:36.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55a3ec7d2f50 con 0x55a3ec7fb300 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadc8bc4740 10 client.0 _ll_register_callbacks cb 0x55a3ec6c0810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec819140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec819140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42664/0 (socket says 172.21.15.84:42664) 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbf7fe640 1 -- 172.21.15.84:0/4169120657 learned_addr learned my addr 172.21.15.84:0/4169120657 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbffff640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec7fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbeffd640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbffff640 1 -- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec81f4b0 msgr2=0x55a3ec7f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbffff640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbffff640 1 -- 172.21.15.84:0/4169120657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 msgr2=0x55a3ec819140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbffff640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec819140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbffff640 1 -- 172.21.15.84:0/4169120657 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ec579420 con 0x55a3ec7fb300 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.325+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec819140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:07:36.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadbffff640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec7fb780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fadb8089e30 tx=0x7fadb805da50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2df015f6a2a42f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fad9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.175:3301/0 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fad9e7fc640 1 -- 172.21.15.84:0/4169120657 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8087020 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fad9e7fc640 1 -- 172.21.15.84:0/4169120657 <== mon.2 v2:172.21.15.175:3301/0 2 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fadb8061f30 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadb4004030 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fad9e7fc640 1 -- 172.21.15.84:0/4169120657 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fadb8058ae0 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 10 client.4733 fetch_fsmap learned FSMap version 13 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a3ec40c580 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fad9e7fc640 1 -- 172.21.15.84:0/4169120657 <== mon.2 v2:172.21.15.175:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb4004030 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fad9e7fc640 1 -- 172.21.15.84:0/4169120657 <== mon.2 v2:172.21.15.175:3301/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fadb8058c80 con 0x55a3ec7fb300 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 10 client.4733 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 10 client.4733 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 20 client.4733 populate_metadata read hostname 'smithi084' 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec81b300 0x55a3ec82a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 4 client.4733 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T11:07:36.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.326+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3ec747a60 con 0x55a3ec81b300 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.327+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec81b300 0x55a3ec82a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.327+0000 7fad9e7fc640 10 client.4733 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.327+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec81b300 0x55a3ec82a170 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9292f7379330ff server_cookie=b254719bc28e6f35 in_seq=0 out_seq=0 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fad9e7fc640 1 -- 172.21.15.84:0/4169120657 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a3ec747a60 con 0x55a3ec81b300 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fad9e7fc640 10 client.4733 handle_command_reply: tid=0 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 client.4733 shutdown 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 msgr2=0x55a3ec7fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec7fb780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fadb8089e30 tx=0x7fadb805da50 comp rx=0 tx=0).stop 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 shutdown_connections 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec81b300 0x55a3ec82a170 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec7fb780 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec81f4b0 0x55a3ec7f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fad9e7fc640 0 client.4733 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/4169120657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec819140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 >> 172.21.15.84:0/4169120657 conn(0x55a3ec7d4090 msgr2=0x55a3ec7d5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:07:36.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 shutdown_connections 2024-04-14T11:07:36.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 1 -- 172.21.15.84:0/4169120657 wait complete. 2024-04-14T11:07:36.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.328+0000 7fadc8bc4740 20 client.4733 trim_cache size 0 max 16384 2024-04-14T11:07:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.348+0000 7fadc8bc4740 1 Processor -- start 2024-04-14T11:07:36.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.348+0000 7fadc8bc4740 1 -- start start 2024-04-14T11:07:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec817490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7fb300 0x55a3ec8179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec81f4b0 0x55a3ec823900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01fe1f0 con 0x55a3ec7d5630 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadc01fd450 con 0x55a3ec7fb300 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fadc01fdb20 con 0x55a3ec81f4b0 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec817490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec817490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42680/0 (socket says 172.21.15.84:42680) 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 -- 172.21.15.84:0/2652549779 learned_addr learned my addr 172.21.15.84:0/2652549779 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbeffd640 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7fb300 0x55a3ec8179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbffff640 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec81f4b0 0x55a3ec823900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 -- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec81f4b0 msgr2=0x55a3ec823900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec81f4b0 0x55a3ec823900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 -- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7fb300 msgr2=0x55a3ec8179d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7fb300 0x55a3ec8179d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 -- 172.21.15.84:0/2652549779 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3ec8185b0 con 0x55a3ec7d5630 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec817490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009930 tx=0x7fadb0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa76c45a0cee44b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fada4ff9640 1 -- 172.21.15.84:0/2652549779 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0034040 con 0x55a3ec7d5630 2024-04-14T11:07:36.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fada4ff9640 1 -- 172.21.15.84:0/2652549779 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb005d070 con 0x55a3ec7d5630 2024-04-14T11:07:36.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.349+0000 7fada4ff9640 1 -- 172.21.15.84:0/2652549779 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb00571e0 con 0x55a3ec7d5630 2024-04-14T11:07:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2652549779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 msgr2=0x55a3ec817490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:07:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec817490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009930 tx=0x7fadb0009240 comp rx=0 tx=0).stop 2024-04-14T11:07:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2652549779 shutdown_connections 2024-04-14T11:07:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec81f4b0 0x55a3ec823900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7fb300 0x55a3ec8179d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2652549779 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec7d5630 0x55a3ec817490 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2652549779 >> 172.21.15.84:0/2652549779 conn(0x55a3ec7d4090 msgr2=0x55a3ec7fab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2652549779 shutdown_connections 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.350+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2652549779 wait complete. 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.351+0000 7fadc8bc4740 1 -- start start 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.351+0000 7fadc8bc4740 1 Processor -- start 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d5630 0x55a3ec894370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec887330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec817490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fadc015e020 con 0x55a3ec81f4b0 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fadc0146f80 con 0x55a3ec7d5630 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fadc01468d0 con 0x55a3ec7fb300 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadc8bc4740 10 client.0 _ll_register_callbacks cb 0x7fadb80592a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec817490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec817490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42696/0 (socket says 172.21.15.84:42696) 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 -- 172.21.15.84:0/2701079786 learned_addr learned my addr 172.21.15.84:0/2701079786 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbeffd640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec887330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d5630 0x55a3ec894370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 -- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 msgr2=0x55a3ec887330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec887330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 -- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d5630 msgr2=0x55a3ec894370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d5630 0x55a3ec894370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbffff640 1 -- 172.21.15.84:0/2701079786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3ec8948b0 con 0x55a3ec81f4b0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.352+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d5630 0x55a3ec894370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadbffff640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec817490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c750 tx=0x7fadb8089cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736188ad43240940 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fad9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fad9e7fc640 1 -- 172.21.15.84:0/2701079786 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8087040 con 0x55a3ec81f4b0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fad9e7fc640 1 -- 172.21.15.84:0/2701079786 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fadb8061f30 con 0x55a3ec81f4b0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadb005d070 con 0x55a3ec81f4b0 2024-04-14T11:07:36.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fad9e7fc640 1 -- 172.21.15.84:0/2701079786 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fadb8059690 con 0x55a3ec81f4b0 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 10 client.5109 fetch_fsmap learned FSMap version 13 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a3ec891700 con 0x55a3ec81f4b0 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fad9e7fc640 1 -- 172.21.15.84:0/2701079786 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb005d070 con 0x55a3ec81f4b0 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fad9e7fc640 1 -- 172.21.15.84:0/2701079786 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fadb8083350 con 0x55a3ec81f4b0 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 10 client.5109 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 10 client.5109 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 20 client.5109 populate_metadata read hostname 'smithi084' 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec8261e0 0x55a3ec8179d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 4 client.5109 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 90.0, "await": true}] 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 90.0, "await": true}) -- 0x55a3ec7418d0 con 0x55a3ec8261e0 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.353+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec8261e0 0x55a3ec8179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.354+0000 7fad9e7fc640 10 client.5109 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:07:36.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:07:36.354+0000 7fadbf7fe640 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec8261e0 0x55a3ec8179d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00a72441b818b9a server_cookie=660b0b6026051aaa in_seq=0 out_seq=0 2024-04-14T11:08:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fad9e7fc640 1 -- 172.21.15.84:0/2701079786 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: -110 ) ==== 8+0+591 (crc 0 0 0) 0x55a3ec7418d0 con 0x55a3ec8261e0 2024-04-14T11:08:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fad9e7fc640 10 client.5109 handle_command_reply: tid=0 2024-04-14T11:08:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 client.5109 shutdown 2024-04-14T11:08:06.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 msgr2=0x55a3ec817490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec817490 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c750 tx=0x7fadb8089cb0 comp rx=0 tx=0).stop 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 shutdown_connections 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55a3ec8261e0 0x55a3ec8179d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a3ec81f4b0 0x55a3ec817490 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55a3ec7fb300 0x55a3ec887330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fad9e7fc640 0 client.5109 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 --2- 172.21.15.84:0/2701079786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a3ec7d5630 0x55a3ec894370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 >> 172.21.15.84:0/2701079786 conn(0x55a3ec7d4090 msgr2=0x55a3ec7d46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 shutdown_connections 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.354+0000 7fadc8bc4740 1 -- 172.21.15.84:0/2701079786 wait complete. 2024-04-14T11:08:06.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:06.355+0000 7fadc8bc4740 20 client.5109 trim_cache size 0 max 16384 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 13, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 4308, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 10, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": { 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "21c59760": { 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "version": 10, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "age_ref": 0.0, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "TIMEDOUT", 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 0.0 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "timeout": 30.0, 2024-04-14T11:08:06.348 INFO:teuthology.orchestra.run.smithi084.stdout: "expiration": 90.0, 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "members": { 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "file:/": { 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "excluded": false, 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "state": { 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "QUIESCING", 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: "age": 30.0 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-04-14T11:08:06.349 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T11:08:06.351 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-14T11:08:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:Error ETIMEDOUT: 2024-04-14T11:08:06.352 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: -124 (EMEDIUMTYPE), stdout: { "epoch": 13, "leader": 4308, "set_version": 10, "sets": { "21c59760": { "version": 10, "age_ref": 0.0, "state": { "name": "TIMEDOUT", "age": 0.0 }, "timeout": 30.0, "expiration": 90.0, "members": { "file:/": { "excluded": false, "state": { "name": "QUIESCING", "age": 30.0 } } } } } } 2024-04-14T11:08:06.352 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 224, in _run self.do_quiesce(d) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 182, in do_quiesce raise RuntimeError(f"Error quiescing root: {rcinfo}") RuntimeError: Error quiescing root: -124 (EMEDIUMTYPE) 2024-04-14T11:08:07.466 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 2% (3/146) Updating files: 3% (5/146) Updating files: 4% (6/146) Updating files: 5% (8/146) Updating files: 6% (9/146) Updating files: 7% (11/146) Updating files: 8% (12/146) Updating files: 9% (14/146) Updating files: 10% (15/146) Updating files: 11% (17/146) Updating files: 12% (18/146) Updating files: 13% (19/146) Updating files: 14% (21/146) Updating files: 15% (22/146) Updating files: 16% (24/146) Updating files: 17% (25/146) Updating files: 18% (27/146) Updating files: 19% (28/146) Updating files: 20% (30/146) Updating files: 21% (31/146) Updating files: 21% (32/146) Updating files: 22% (33/146) Updating files: 23% (34/146) Updating files: 24% (36/146) Updating files: 25% (37/146) Updating files: 26% (38/146) Updating files: 27% (40/146) Updating files: 28% (41/146) Updating files: 29% (43/146) Updating files: 30% (44/146) Updating files: 31% (46/146) Updating files: 32% (47/146) Updating files: 33% (49/146) Updating files: 34% (50/146) Updating files: 35% (52/146) Updating files: 36% (53/146) Updating files: 37% (55/146) Updating files: 38% (56/146) Updating files: 39% (57/146) Updating files: 40% (59/146) Updating files: 41% (60/146) Updating files: 42% (62/146) Updating files: 43% (63/146) Updating files: 44% (65/146) Updating files: 45% (66/146) Updating files: 46% (68/146) Updating files: 47% (69/146) Updating files: 48% (71/146) Updating files: 49% (72/146) Updating files: 50% (73/146) Updating files: 51% (75/146) Updating files: 52% (76/146) Updating files: 53% (78/146) Updating files: 54% (79/146) Updating files: 55% (81/146) Updating files: 56% (82/146) Updating files: 57% (84/146) Updating files: 58% (85/146) Updating files: 59% (87/146) Updating files: 60% (88/146) Updating files: 61% (90/146) Updating files: 62% (91/146) Updating files: 63% (92/146) Updating files: 64% (94/146) Updating files: 65% (95/146) Updating files: 66% (97/146) Updating files: 67% (98/146) Updating files: 68% (100/146) Updating files: 69% (101/146) Updating files: 70% (103/146) Updating files: 71% (104/146) Updating files: 72% (106/146) Updating files: 73% (107/146) Updating files: 74% (109/146) Updating files: 75% (110/146) Updating files: 76% (111/146) Updating files: 77% (113/146) Updating files: 78% (114/146) Updating files: 79% (116/146) Updating files: 80% (117/146) Updating files: 81% (119/146) Updating files: 82% (120/146) Updating files: 83% (122/146) Updating files: 84% (123/146) Updating files: 85% (125/146) Updating files: 86% (126/146) Updating files: 87% (128/146) Updating files: 88% (129/146) Updating files: 89% (130/146) Updating files: 90% (132/146) Updating files: 91% (133/146) Updating files: 92% (135/146) Updating files: 93% (136/146) Updating files: 94% (138/146) Updating files: 95% (139/146) Updating files: 96% (141/146) Updating files: 97% (142/146) Updating files: 98% (144/146) Updating files: 99% (145/146) Updating files: 100% (146/146) Updating files: 100% (146/146), done. 2024-04-14T11:08:07.626 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 054e96cf79e v0.63 2024-04-14T11:08:07.629 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.63 2024-04-14T11:08:07.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:08:07.670 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 64 -eq 48 ']' 2024-04-14T11:08:07.670 INFO:tasks.workunit.client.0.smithi084.stdout:v0.64 2024-04-14T11:08:07.671 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.64 2024-04-14T11:08:07.671 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.64 2024-04-14T11:08:07.671 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.64 2024-04-14T11:08:09.552 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at 42e06c12db6 v0.64 2024-04-14T11:08:09.553 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.64 2024-04-14T11:08:09.618 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:08:09.618 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 65 -eq 48 ']' 2024-04-14T11:08:09.619 INFO:tasks.workunit.client.0.smithi084.stdout:v0.65 2024-04-14T11:08:09.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.65 2024-04-14T11:08:09.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.65 2024-04-14T11:08:09.619 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.65 2024-04-14T11:08:11.570 INFO:tasks.workunit.client.0.smithi084.stderr:Updating files: 83% (169/203) Updating files: 84% (171/203) Updating files: 85% (173/203) Updating files: 86% (175/203) Updating files: 87% (177/203) Updating files: 88% (179/203) Updating files: 89% (181/203) Updating files: 90% (183/203) Updating files: 91% (185/203) Updating files: 92% (187/203) Updating files: 93% (189/203) Updating files: 94% (191/203) Updating files: 95% (193/203) Updating files: 96% (195/203) Updating files: 97% (197/203) Updating files: 98% (199/203) Updating files: 99% (201/203) Updating files: 100% (203/203) Updating files: 100% (203/203), done. 2024-04-14T11:08:11.749 INFO:tasks.workunit.client.0.smithi084.stdout:HEAD is now at c2d517ef966 v0.65 2024-04-14T11:08:11.752 INFO:tasks.workunit.client.0.smithi084.stderr:+ mkdir .snap/v0.65 2024-04-14T11:08:11.823 INFO:tasks.workunit.client.0.smithi084.stderr:+ for v in $versions 2024-04-14T11:08:11.823 INFO:tasks.workunit.client.0.smithi084.stderr:+ '[' 66 -eq 48 ']' 2024-04-14T11:08:11.824 INFO:tasks.workunit.client.0.smithi084.stdout:v0.66 2024-04-14T11:08:11.824 INFO:tasks.workunit.client.0.smithi084.stderr:+ ver=v0.66 2024-04-14T11:08:11.824 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo v0.66 2024-04-14T11:08:11.824 INFO:tasks.workunit.client.0.smithi084.stderr:+ git reset --hard v0.66 2024-04-14T11:08:13.066 INFO:tasks.daemonwatchdog.daemon_watchdog:quiescer.fs.[cephfs] failed 2024-04-14T11:08:13.066 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-14T11:08:13.066 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T11:08:13.066 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T11:08:13.083 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T11:08:13.158 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/MonClient.h: Transport endpoint is not connected 2024-04-14T11:08:13.159 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/MonCommands.h: Transport endpoint is not connected 2024-04-14T11:08:13.160 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/Monitor.cc: Transport endpoint is not connected 2024-04-14T11:08:13.160 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/Monitor.h: Transport endpoint is not connected 2024-04-14T11:08:13.161 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/MonmapMonitor.cc: Transport endpoint is not connected 2024-04-14T11:08:13.161 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/MonmapMonitor.h: Transport endpoint is not connected 2024-04-14T11:08:13.164 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/OSDMonitor.cc: Transport endpoint is not connected 2024-04-14T11:08:13.164 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/OSDMonitor.h: Transport endpoint is not connected 2024-04-14T11:08:13.165 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/PGMonitor.cc: Transport endpoint is not connected 2024-04-14T11:08:13.165 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/PGMonitor.h: Transport endpoint is not connected 2024-04-14T11:08:13.165 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/Paxos.cc: Transport endpoint is not connected 2024-04-14T11:08:13.165 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/Paxos.h: Transport endpoint is not connected 2024-04-14T11:08:13.165 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/PaxosService.cc: Transport endpoint is not connected 2024-04-14T11:08:13.165 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/PaxosService.h: Transport endpoint is not connected 2024-04-14T11:08:13.166 INFO:tasks.workunit.client.0.smithi084.stderr:error: unable to create file src/mon/Session.h: Transport endpoint is not connected 2024-04-14T11:08:13.166 INFO:tasks.workunit.client.0.smithi084.stderr:fatal: cannot create directory at 'src/msg': Transport endpoint is not connected 2024-04-14T11:08:13.167 INFO:tasks.workunit.client.0.smithi084.stderr:warning: unable to unlink '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph/.git/index.lock': Transport endpoint is not connected 2024-04-14T11:08:13.170 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-04-14T11:08:13.170 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-04-14T11:08:13.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-14T11:08:13.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.239+0000 7f7fdc7f0640 1 Processor -- start 2024-04-14T11:08:13.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.239+0000 7f7fdc7f0640 1 -- start start 2024-04-14T11:08:13.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fdc7f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd40b3930 0x7f7fd415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fdc7f0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7fd415b500 0x7f7fd40cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fdc7f0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd40ccd90 con 0x7f7fd4155160 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fdc7f0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd415b990 con 0x7f7fd415b500 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fdc7f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd415e4d0 con 0x7f7fd40b3930 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fda58c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7fd4155160 0x7f7fd40cb3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53856/0 (socket says 172.21.15.84:53856) 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fda58c640 1 -- 172.21.15.84:0/3936363183 learned_addr learned my addr 172.21.15.84:0/3936363183 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fd9d8b640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd40b3930 0x7f7fd415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fdad8d640 1 --2- 172.21.15.84:0/3936363183 >> v2:172.21.15.175:3300/0 conn(0x7f7fd415b500 0x7f7fd40cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fd958a640 1 -- 172.21.15.84:0/3936363183 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 66667994 0 0) 0x7f7fd40ccd90 con 0x7f7fd4155160 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.240+0000 7f7fd958a640 1 -- 172.21.15.84:0/3936363183 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc0003520 con 0x7f7fd4155160 2024-04-14T11:08:13.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.241+0000 7f7fdad8d640 1 -- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd40b3930 msgr2=0x7f7fd415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.241+0000 7f7fdad8d640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd40b3930 0x7f7fd415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.241+0000 7f7fdad8d640 1 -- 172.21.15.84:0/3936363183 >> v1:172.21.15.84:6789/0 conn(0x7f7fd4155160 legacy=0x7f7fd40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.241+0000 7f7fdad8d640 1 -- 172.21.15.84:0/3936363183 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd415e7b0 con 0x7f7fd415b500 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.241+0000 7f7fd9d8b640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd40b3930 0x7f7fd415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdad8d640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd415b500 0x7f7fd40cc150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00097a0 tx=0x7f7fd002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6621f46a65e495a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fd958a640 1 -- 172.21.15.84:0/3936363183 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0034070 con 0x7f7fd415b500 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fd958a640 1 -- 172.21.15.84:0/3936363183 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd0030610 con 0x7f7fd415b500 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fd958a640 1 -- 172.21.15.84:0/3936363183 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00309e0 con 0x7f7fd415b500 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd415b500 msgr2=0x7f7fd40cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd415b500 0x7f7fd40cc150 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00097a0 tx=0x7f7fd002b960 comp rx=0 tx=0).stop 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/3936363183 shutdown_connections 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd40b3930 0x7f7fd415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/3936363183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd415b500 0x7f7fd40cc150 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/3936363183 >> 172.21.15.84:0/3936363183 conn(0x7f7fd406b900 msgr2=0x7f7fd406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:13.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/3936363183 shutdown_connections 2024-04-14T11:08:13.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.242+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/3936363183 wait complete. 2024-04-14T11:08:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.243+0000 7f7fdc7f0640 1 Processor -- start 2024-04-14T11:08:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 -- start start 2024-04-14T11:08:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd40b3930 0x7f7fd40c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd4155160 0x7f7fd40c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 0x7f7fd41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd415f050 con 0x7f7fd415b500 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd415ed70 con 0x7f7fd40b3930 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdc7f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd4155540 con 0x7f7fd4155160 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdad8d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 0x7f7fd41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdad8d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 0x7f7fd41565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59418/0 (socket says 172.21.15.84:59418) 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fdad8d640 1 -- 172.21.15.84:0/1789501793 learned_addr learned my addr 172.21.15.84:0/1789501793 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fd9d8b640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd4155160 0x7f7fd40c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.244+0000 7f7fda58c640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd40b3930 0x7f7fd40c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fd9d8b640 1 -- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd40b3930 msgr2=0x7f7fd40c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fd9d8b640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd40b3930 0x7f7fd40c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fd9d8b640 1 -- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 msgr2=0x7f7fd41565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fd9d8b640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 0x7f7fd41565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fd9d8b640 1 -- 172.21.15.84:0/1789501793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd40d0cd0 con 0x7f7fd4155160 2024-04-14T11:08:13.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fda58c640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd40b3930 0x7f7fd40c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fdad8d640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 0x7f7fd41565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fd9d8b640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd4155160 0x7f7fd40c9a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800e900 tx=0x7f7fc800edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8017070 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc800ca00 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd41f1120 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800cdf0 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.245+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd41f1400 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.246+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd40d11b0 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.247+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fc801a070 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.247+0000 7f7fc6ffd640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7fb806c8f0 0x7f7fb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.247+0000 7f7fda58c640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7fb806c8f0 0x7f7fb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.247+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f7fc808bab0 con 0x7f7fd4155160 2024-04-14T11:08:13.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.248+0000 7f7fda58c640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7fb806c8f0 0x7f7fb806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005c00 tx=0x7f7fcc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.252+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f7fd40d11b0 con 0x7f7fd4155160 2024-04-14T11:08:13.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.435+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fd40ca580 con 0x7f7fd4155160 2024-04-14T11:08:13.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.436+0000 7f7fc6ffd640 1 -- 172.21.15.84:0/1789501793 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17039 (secure 0 0 0) 0x7f7fd40ca580 con 0x7f7fd4155160 2024-04-14T11:08:13.427 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:13.427 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T11:01:54.049114+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2c","mappings":[{"from":4,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":504,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.438+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7fb806c8f0 msgr2=0x7f7fb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.438+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7fb806c8f0 0x7f7fb806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005c00 tx=0x7f7fcc009040 comp rx=0 tx=0).stop 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.438+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd4155160 msgr2=0x7f7fd40c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.438+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd4155160 0x7f7fd40c9a30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800e900 tx=0x7f7fc800edc0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 shutdown_connections 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7fb806c8f0 0x7f7fb806edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fd415b500 0x7f7fd41565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fd4155160 0x7f7fd40c9a30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 --2- 172.21.15.84:0/1789501793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fd40b3930 0x7f7fd40c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 >> 172.21.15.84:0/1789501793 conn(0x7f7fd406b900 msgr2=0x7f7fd4153440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:13.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 shutdown_connections 2024-04-14T11:08:13.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.439+0000 7f7fdc7f0640 1 -- 172.21.15.84:0/1789501793 wait complete. 2024-04-14T11:08:13.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T11:08:13.442 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T11:08:13.486 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi084 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-14T11:08:13.751 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=91ca3e1597fe43c585d58ea54183875b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi084 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-14T11:08:13.753 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-14T11:08:13.764 INFO:tasks.quiescer:joining Quiescers 2024-04-14T11:08:13.764 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T11:08:13.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.598+0000 7f9b2c3cf640 1 Processor -- start 2024-04-14T11:08:13.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.598+0000 7f9b2c3cf640 1 -- start start 2024-04-14T11:08:13.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2c3cf640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b240ccfd0 0x7f9b24154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2c3cf640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2415e910 con 0x7f9b2415e3b0 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2c3cf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2415ebf0 con 0x7f9b240ccbf0 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2c3cf640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f9b240c45f0 con 0x7f9b240ccfd0 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2996a640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f9b240ccfd0 0x7f9b24154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2a96c640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9b2415e3b0 0x7f9b240c3610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53872/0 (socket says 172.21.15.84:53872) 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2a96c640 1 -- 172.21.15.84:0/1339247505 learned_addr learned my addr 172.21.15.84:0/1339247505 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:13.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2996a640 1 -- 172.21.15.84:0/1339247505 >> v1:172.21.15.175:6789/0 conn(0x7f9b240ccbf0 legacy=0x7f9b240c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2996a640 1 -- 172.21.15.84:0/1339247505 >> v1:172.21.15.84:6789/0 conn(0x7f9b2415e3b0 legacy=0x7f9b240c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b2996a640 1 -- 172.21.15.84:0/1339247505 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2415eed0 con 0x7f9b240ccfd0 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.599+0000 7f9b29169640 1 -- 172.21.15.84:0/1339247505 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045522830 0 0) 0x7f9b2415e910 con 0x7f9b2415e3b0 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.600+0000 7f9b2996a640 1 --2- 172.21.15.84:0/1339247505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccfd0 0x7f9b24154c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9b140097a0 tx=0x7f9b1402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf37c68cd26484 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.600+0000 7f9b29169640 1 -- 172.21.15.84:0/1339247505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1402f810 con 0x7f9b240ccfd0 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.600+0000 7f9b29169640 1 -- 172.21.15.84:0/1339247505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1402f9b0 con 0x7f9b240ccfd0 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.600+0000 7f9b29169640 1 -- 172.21.15.84:0/1339247505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1402fd80 con 0x7f9b240ccfd0 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/1339247505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccfd0 msgr2=0x7f9b24154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/1339247505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccfd0 0x7f9b24154c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9b140097a0 tx=0x7f9b1402b9f0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/1339247505 shutdown_connections 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/1339247505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccfd0 0x7f9b24154c80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/1339247505 >> 172.21.15.84:0/1339247505 conn(0x7f9b24067900 msgr2=0x7f9b2406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/1339247505 shutdown_connections 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.601+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/1339247505 wait complete. 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 Processor -- start 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 -- start start 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 0x7f9b240c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b240ccfd0 0x7f9b2406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b2415e3b0 0x7f9b2406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9b240c5190 con 0x7f9b240ccbf0 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415f1b0 con 0x7f9b240ccfd0 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.602+0000 7f9b2c3cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9b240c5310 con 0x7f9b2415e3b0 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 0x7f9b240c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 0x7f9b240c9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59440/0 (socket says 172.21.15.84:59440) 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 -- 172.21.15.84:0/2631058564 learned_addr learned my addr 172.21.15.84:0/2631058564 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a96c640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b2415e3b0 0x7f9b2406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2996a640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b240ccfd0 0x7f9b2406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 -- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b2415e3b0 msgr2=0x7f9b2406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b2415e3b0 0x7f9b2406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 -- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b240ccfd0 msgr2=0x7f9b2406d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b240ccfd0 0x7f9b2406d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 -- 172.21.15.84:0/2631058564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2406be60 con 0x7f9b240ccbf0 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2a16b640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 0x7f9b240c9360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c450 tx=0x7f9b2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b200052d0 con 0x7f9b240ccbf0 2024-04-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20005470 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b241f42b0 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20012870 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.603+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b241f4570 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.604+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b24069b20 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.605+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b20012a10 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.605+0000 7f9b1affd640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b0806c920 0x7f9b0806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.605+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f9b2008b740 con 0x7f9b240ccbf0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.605+0000 7f9b2996a640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b0806c920 0x7f9b0806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.605+0000 7f9b2996a640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b0806c920 0x7f9b0806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b14036000 tx=0x7f9b14008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.609+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f9b200593a0 con 0x7f9b240ccbf0 2024-04-14T11:08:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.805+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b241f4740 con 0x7f9b240ccbf0 2024-04-14T11:08:13.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.806+0000 7f9b1affd640 1 -- 172.21.15.84:0/2631058564 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f9b2005d6a0 con 0x7f9b240ccbf0 2024-04-14T11:08:13.796 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T11:08:13.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b0806c920 msgr2=0x7f9b0806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b0806c920 0x7f9b0806ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9b14036000 tx=0x7f9b14008030 comp rx=0 tx=0).stop 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 msgr2=0x7f9b240c9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 0x7f9b240c9360 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000c450 tx=0x7f9b2000c910 comp rx=0 tx=0).stop 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 shutdown_connections 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9b0806c920 0x7f9b0806ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b2415e3b0 0x7f9b2406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b240ccfd0 0x7f9b2406d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 --2- 172.21.15.84:0/2631058564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9b240ccbf0 0x7f9b240c9360 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 >> 172.21.15.84:0/2631058564 conn(0x7f9b24067900 msgr2=0x7f9b240c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:13.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 shutdown_connections 2024-04-14T11:08:13.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.808+0000 7f9b2c3cf640 1 -- 172.21.15.84:0/2631058564 wait complete. 2024-04-14T11:08:13.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T11:08:13.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.892+0000 7f00e9708640 1 Processor -- start 2024-04-14T11:08:13.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.892+0000 7f00e9708640 1 -- start start 2024-04-14T11:08:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.892+0000 7f00e9708640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e9708640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e4157a70 con 0x7f00e4072c10 2024-04-14T11:08:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e9708640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00e40c68d0 con 0x7f00e4073c30 2024-04-14T11:08:13.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e9708640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f00e40c7450 con 0x7f00e4072ff0 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e2ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f00e4072c10 0x7f00e40c4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53886/0 (socket says 172.21.15.84:53886) 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e2ffd640 1 -- 172.21.15.84:0/3064822072 learned_addr learned my addr 172.21.15.84:0/3064822072 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e27fc640 1 --2- 172.21.15.84:0/3064822072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332116662 0 0) 0x7f00e4157a70 con 0x7f00e4072c10 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00cc003520 con 0x7f00e4072c10 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400095823 0 0) 0x7f00e40c68d0 con 0x7f00e4073c30 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00e4157a70 con 0x7f00e4073c30 2024-04-14T11:08:13.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2104715162 0 0) 0x7f00cc003520 con 0x7f00e4072c10 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e27fc640 1 -- 172.21.15.84:0/3064822072 >> v1:172.21.15.175:6789/0 conn(0x7f00e4073c30 legacy=0x7f00e41518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e27fc640 1 -- 172.21.15.84:0/3064822072 >> v1:172.21.15.84:6789/0 conn(0x7f00e4072c10 legacy=0x7f00e40c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.893+0000 7f00e27fc640 1 -- 172.21.15.84:0/3064822072 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e40c6bb0 con 0x7f00e4072ff0 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.894+0000 7f00e27fc640 1 --2- 172.21.15.84:0/3064822072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415b660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f00d80097d0 tx=0x7f00d802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9c45c690e2caa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4001670 con 0x7f00e4072ff0 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d8037070 con 0x7f00e4072ff0 2024-04-14T11:08:13.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e1ffb640 1 -- 172.21.15.84:0/3064822072 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d80317a0 con 0x7f00e4072ff0 2024-04-14T11:08:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 -- 172.21.15.84:0/3064822072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 msgr2=0x7f00e415b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 --2- 172.21.15.84:0/3064822072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415b660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f00d80097d0 tx=0x7f00d802b8a0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 -- 172.21.15.84:0/3064822072 shutdown_connections 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 --2- 172.21.15.84:0/3064822072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415b660 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 -- 172.21.15.84:0/3064822072 >> 172.21.15.84:0/3064822072 conn(0x7f00e40cdc60 msgr2=0x7f00e40c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 -- 172.21.15.84:0/3064822072 shutdown_connections 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.895+0000 7f00e9708640 1 -- 172.21.15.84:0/3064822072 wait complete. 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.896+0000 7f00e9708640 1 Processor -- start 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 -- start start 2024-04-14T11:08:13.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4072c10 0x7f00e41e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 0x7f00e415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f00e40c5080 con 0x7f00e4073c30 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00e40c7170 con 0x7f00e4072c10 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e9708640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f00e4151fb0 con 0x7f00e4072ff0 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 0x7f00e415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 0x7f00e415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59450/0 (socket says 172.21.15.84:59450) 2024-04-14T11:08:13.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e37fe640 1 -- 172.21.15.84:0/3592307816 learned_addr learned my addr 172.21.15.84:0/3592307816 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e2ffd640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4072c10 0x7f00e41e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.897+0000 7f00e27fc640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e37fe640 1 -- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 msgr2=0x7f00e415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e37fe640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e37fe640 1 -- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4072c10 msgr2=0x7f00e41e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e37fe640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4072c10 0x7f00e41e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e37fe640 1 -- 172.21.15.84:0/3592307816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e4159960 con 0x7f00e4073c30 2024-04-14T11:08:13.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e2ffd640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4072c10 0x7f00e41e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e37fe640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 0x7f00e415a660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c6e0 tx=0x7f00dc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc003b70 con 0x7f00e4073c30 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc003d10 con 0x7f00e4073c30 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0052d0 con 0x7f00e4073c30 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e40c8a50 con 0x7f00e4073c30 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.898+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e4159c00 con 0x7f00e4073c30 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.899+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e4069c30 con 0x7f00e4073c30 2024-04-14T11:08:13.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.899+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00dc005470 con 0x7f00e4073c30 2024-04-14T11:08:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.900+0000 7f00cb7fe640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f00d006c8f0 0x7f00d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.900+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f00dc08ba60 con 0x7f00e4073c30 2024-04-14T11:08:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.900+0000 7f00e2ffd640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f00d006c8f0 0x7f00d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.900+0000 7f00e2ffd640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f00d006c8f0 0x7f00d006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f00d40011e0 tx=0x7f00d4001690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.904+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f00dc0596c0 con 0x7f00e4073c30 2024-04-14T11:08:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.968+0000 7f23ebb15640 1 Processor -- start 2024-04-14T11:08:13.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.969+0000 7f23ebb15640 1 -- start start 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ebb15640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 0x7f23e415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ebb15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f23e40cba60 0x7f23e40c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ebb15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e4155630 con 0x7f23e40cb610 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ebb15640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f23e415f370 con 0x7f23e4155250 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ebb15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f23e40cbfa0 con 0x7f23e40cba60 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23e98b1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 0x7f23e415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23e98b1640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 0x7f23e415ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59452/0 (socket says 172.21.15.84:59452) 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23e98b1640 1 -- 172.21.15.84:0/419151526 learned_addr learned my addr 172.21.15.84:0/419151526 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ea0b2640 1 --2- 172.21.15.84:0/419151526 >> v2:172.21.15.175:3300/0 conn(0x7f23e40cba60 0x7f23e40c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ea0b2640 1 -- 172.21.15.84:0/419151526 >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 msgr2=0x7f23e415ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ea0b2640 1 --2- 172.21.15.84:0/419151526 >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 0x7f23e415ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ea0b2640 1 -- 172.21.15.84:0/419151526 >> v1:172.21.15.175:6789/0 conn(0x7f23e40cb610 legacy=0x7f23e40cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23e88af640 1 -- 172.21.15.84:0/419151526 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057821951 0 0) 0x7f23e4155630 con 0x7f23e40cb610 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23ea0b2640 1 -- 172.21.15.84:0/419151526 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e415b050 con 0x7f23e40cba60 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.970+0000 7f23e98b1640 1 --2- 172.21.15.84:0/419151526 >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 0x7f23e415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:13.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.971+0000 7f23ea0b2640 1 --2- 172.21.15.84:0/419151526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cba60 0x7f23e40c56b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23e406cfc0 tx=0x7f23dc02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32cc18d41fb460af server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.971+0000 7f23e88af640 1 -- 172.21.15.84:0/419151526 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc039070 con 0x7f23e40cba60 2024-04-14T11:08:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.971+0000 7f23e88af640 1 -- 172.21.15.84:0/419151526 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc02cd00 con 0x7f23e40cba60 2024-04-14T11:08:13.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.971+0000 7f23e88af640 1 -- 172.21.15.84:0/419151526 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc034660 con 0x7f23e40cba60 2024-04-14T11:08:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 -- 172.21.15.84:0/419151526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cba60 msgr2=0x7f23e40c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 --2- 172.21.15.84:0/419151526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cba60 0x7f23e40c56b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23e406cfc0 tx=0x7f23dc02bf50 comp rx=0 tx=0).stop 2024-04-14T11:08:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 -- 172.21.15.84:0/419151526 shutdown_connections 2024-04-14T11:08:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 --2- 172.21.15.84:0/419151526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cba60 0x7f23e40c56b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 --2- 172.21.15.84:0/419151526 >> v2:172.21.15.84:3300/0 conn(0x7f23e4155250 0x7f23e415ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 -- 172.21.15.84:0/419151526 >> 172.21.15.84:0/419151526 conn(0x7f23e4067720 msgr2=0x7f23e40729b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 -- 172.21.15.84:0/419151526 shutdown_connections 2024-04-14T11:08:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.972+0000 7f23ebb15640 1 -- 172.21.15.84:0/419151526 wait complete. 2024-04-14T11:08:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.974+0000 7f23ebb15640 1 Processor -- start 2024-04-14T11:08:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.974+0000 7f23ebb15640 1 -- start start 2024-04-14T11:08:13.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23ebb15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cb610 0x7f23e41507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23ebb15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 0x7f23e41f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23ebb15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e4155250 0x7f23e41f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23ebb15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f23e415b8f0 con 0x7f23e40cba60 2024-04-14T11:08:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23ebb15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23e415b610 con 0x7f23e40cb610 2024-04-14T11:08:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23ebb15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f23e415bbd0 con 0x7f23e4155250 2024-04-14T11:08:13.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.975+0000 7f23e90b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 0x7f23e41f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 0x7f23e41f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59468/0 (socket says 172.21.15.84:59468) 2024-04-14T11:08:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 -- 172.21.15.84:0/158362394 learned_addr learned my addr 172.21.15.84:0/158362394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e98b1640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cb610 0x7f23e41507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23ea0b2640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e4155250 0x7f23e41f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 -- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e4155250 msgr2=0x7f23e41f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e4155250 0x7f23e41f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 -- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cb610 msgr2=0x7f23e41507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cb610 0x7f23e41507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 -- 172.21.15.84:0/158362394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e40b42d0 con 0x7f23e40cba60 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23e90b0640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 0x7f23e41f4570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c440 tx=0x7f23e000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0017070 con 0x7f23e40cba60 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e0005480 con 0x7f23e40cba60 2024-04-14T11:08:13.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0003830 con 0x7f23e40cba60 2024-04-14T11:08:13.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e415d9d0 con 0x7f23e40cba60 2024-04-14T11:08:13.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.976+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e415df90 con 0x7f23e40cba60 2024-04-14T11:08:13.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.977+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4069b20 con 0x7f23e40cba60 2024-04-14T11:08:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.978+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23e001a070 con 0x7f23e40cba60 2024-04-14T11:08:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.978+0000 7f23da7fc640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f23c806c920 0x7f23c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.978+0000 7f23e98b1640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f23c806c920 0x7f23c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.978+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f23e008ad80 con 0x7f23e40cba60 2024-04-14T11:08:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.979+0000 7f23e98b1640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f23c806c920 0x7f23c806ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23d4006ca0 tx=0x7f23d4009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:13.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:13.982+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f23e40b42d0 con 0x7f23e40cba60 2024-04-14T11:08:14.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.132+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e40c8f70 con 0x7f00e4073c30 2024-04-14T11:08:14.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.133+0000 7f00cb7fe640 1 -- 172.21.15.84:0/3592307816 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6869 (secure 0 0 0) 0x7f00dc05d9c0 con 0x7f00e4073c30 2024-04-14T11:08:14.124 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:14.124 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6836/2209499212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":2209499212},{"type":"v1","addr":"172.21.15.84:6836","nonce":2209499212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/3419471695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6835","nonce":3419471695},{"type":"v1","addr":"172.21.15.84:6837","nonce":3419471695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/2025762309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":2025762309},{"type":"v1","addr":"172.21.15.84:6839","nonce":2025762309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:58:03.536145+0000","modified":"2024-04-14T10:58:21.259734+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4308,"mds_1":4303,"mds_2":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6834/903884939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":903884939},{"type":"v1","addr":"172.21.15.175:6834","nonce":903884939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4303":{"gid":4303,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/442498992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":442498992},{"type":"v1","addr":"172.21.15.175:6837","nonce":442498992}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.175:6835/3381016657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6833","nonce":3381016657},{"type":"v1","addr":"172.21.15.175:6835","nonce":3381016657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4308,"qdb_cluster":[4297,4303,4308]},"id":1}]} 2024-04-14T11:08:14.124 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-04-14T11:08:14.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f00d006c8f0 msgr2=0x7f00d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f00d006c8f0 0x7f00d006edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f00d40011e0 tx=0x7f00d4001690 comp rx=0 tx=0).stop 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 msgr2=0x7f00e415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 0x7f00e415a660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c6e0 tx=0x7f00dc00cba0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 shutdown_connections 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f00d006c8f0 0x7f00d006edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f00e4073c30 0x7f00e415a660 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00e4072ff0 0x7f00e415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 --2- 172.21.15.84:0/3592307816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00e4072c10 0x7f00e41e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 >> 172.21.15.84:0/3592307816 conn(0x7f00e40cdc60 msgr2=0x7f00e4067720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 shutdown_connections 2024-04-14T11:08:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.135+0000 7f00e9708640 1 -- 172.21.15.84:0/3592307816 wait complete. 2024-04-14T11:08:14.137 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4308 quiesce db --cancel --all' 2024-04-14T11:08:14.137 DEBUG:teuthology.orchestra.run.smithi084:> timeout 30 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4308 quiesce db --cancel --all 2024-04-14T11:08:14.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.165+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f23e4154a70 con 0x7f23e40cba60 2024-04-14T11:08:14.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.166+0000 7f23da7fc640 1 -- 172.21.15.84:0/158362394 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7f23e0058b00 con 0x7f23e40cba60 2024-04-14T11:08:14.157 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f23c806c920 msgr2=0x7f23c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f23c806c920 0x7f23c806ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23d4006ca0 tx=0x7f23d4009240 comp rx=0 tx=0).stop 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 msgr2=0x7f23e41f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 0x7f23e41f4570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c440 tx=0x7f23e000c900 comp rx=0 tx=0).stop 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 shutdown_connections 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f23c806c920 0x7f23c806ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f23e4155250 0x7f23e41f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f23e40cba60 0x7f23e41f4570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 --2- 172.21.15.84:0/158362394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23e40cb610 0x7f23e41507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 >> 172.21.15.84:0/158362394 conn(0x7f23e4067720 msgr2=0x7f23e40cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 shutdown_connections 2024-04-14T11:08:14.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.168+0000 7f23ebb15640 1 -- 172.21.15.84:0/158362394 wait complete. 2024-04-14T11:08:14.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T11:08:14.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.277+0000 7fe451c0f640 1 Processor -- start 2024-04-14T11:08:14.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.277+0000 7fe451c0f640 1 -- start start 2024-04-14T11:08:14.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe451c0f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe44c15ef30 0x7fe44c166790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe451c0f640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44c15f360 con 0x7fe44c15eaf0 2024-04-14T11:08:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe451c0f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44c155630 con 0x7fe44c155250 2024-04-14T11:08:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe451c0f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe44c15e660 con 0x7fe44c15ef30 2024-04-14T11:08:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44affd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe44c15eaf0 0x7fe44c0c2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53890/0 (socket says 172.21.15.84:53890) 2024-04-14T11:08:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44affd640 1 -- 172.21.15.84:0/707977117 learned_addr learned my addr 172.21.15.84:0/707977117 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:14.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44bfff640 1 --2- 172.21.15.84:0/707977117 >> v2:172.21.15.175:3300/0 conn(0x7fe44c15ef30 0x7fe44c166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596433907 0 0) 0x7fe44c155630 con 0x7fe44c155250 2024-04-14T11:08:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe434003520 con 0x7fe44c155250 2024-04-14T11:08:14.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097686957 0 0) 0x7fe440001110 con 0x7fe44c15eaf0 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.278+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe44c155630 con 0x7fe44c15eaf0 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.279+0000 7fe44bfff640 1 -- 172.21.15.84:0/707977117 >> v1:172.21.15.175:6789/0 conn(0x7fe44c155250 legacy=0x7fe44c0ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.279+0000 7fe44bfff640 1 -- 172.21.15.84:0/707977117 >> v1:172.21.15.84:6789/0 conn(0x7fe44c15eaf0 legacy=0x7fe44c0c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.279+0000 7fe44bfff640 1 -- 172.21.15.84:0/707977117 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c0cc700 con 0x7fe44c15ef30 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.280+0000 7fe44bfff640 1 --2- 172.21.15.84:0/707977117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15ef30 0x7fe44c166790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe444009d90 tx=0x7fe44402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43831bc11b1b14a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.280+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444039070 con 0x7fe44c15ef30 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.280+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44402cd80 con 0x7fe44c15ef30 2024-04-14T11:08:14.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.280+0000 7fe44a7fc640 1 -- 172.21.15.84:0/707977117 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444034640 con 0x7fe44c15ef30 2024-04-14T11:08:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 -- 172.21.15.84:0/707977117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15ef30 msgr2=0x7fe44c166790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 --2- 172.21.15.84:0/707977117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15ef30 0x7fe44c166790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe444009d90 tx=0x7fe44402bfd0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 -- 172.21.15.84:0/707977117 shutdown_connections 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 --2- 172.21.15.84:0/707977117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15ef30 0x7fe44c166790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 -- 172.21.15.84:0/707977117 >> 172.21.15.84:0/707977117 conn(0x7fe44c067b40 msgr2=0x7fe44c06fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 -- 172.21.15.84:0/707977117 shutdown_connections 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.281+0000 7fe451c0f640 1 -- 172.21.15.84:0/707977117 wait complete. 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.282+0000 7fe451c0f640 1 Processor -- start 2024-04-14T11:08:14.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.282+0000 7fe451c0f640 1 -- start start 2024-04-14T11:08:14.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe451c0f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 0x7fe44c14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe451c0f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15eaf0 0x7fe44c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe451c0f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe44c15ef30 0x7fe44c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe451c0f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c0ccca0 con 0x7fe44c155250 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe451c0f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c15aee0 con 0x7fe44c15eaf0 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe451c0f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c0ccf80 con 0x7fe44c15ef30 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 0x7fe44c14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 0x7fe44c14f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59478/0 (socket says 172.21.15.84:59478) 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 -- 172.21.15.84:0/2461710617 learned_addr learned my addr 172.21.15.84:0/2461710617 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44affd640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15eaf0 0x7fe44c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44bfff640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe44c15ef30 0x7fe44c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 -- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe44c15ef30 msgr2=0x7fe44c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe44c15ef30 0x7fe44c0c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 -- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15eaf0 msgr2=0x7fe44c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15eaf0 0x7fe44c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 -- 172.21.15.84:0/2461710617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44c152250 con 0x7fe44c155250 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 0x7fe44c14f6c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00c3c0 tx=0x7fe43c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.283+0000 7fe433fff640 1 -- 172.21.15.84:0/2461710617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c017070 con 0x7fe44c155250 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.284+0000 7fe433fff640 1 -- 172.21.15.84:0/2461710617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c0052d0 con 0x7fe44c155250 2024-04-14T11:08:14.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.284+0000 7fe433fff640 1 -- 172.21.15.84:0/2461710617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c003830 con 0x7fe44c155250 2024-04-14T11:08:14.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.284+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44c14ea70 con 0x7fe44c155250 2024-04-14T11:08:14.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.284+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44c1527d0 con 0x7fe44c155250 2024-04-14T11:08:14.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.286+0000 7fe433fff640 1 -- 172.21.15.84:0/2461710617 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe43c01a070 con 0x7fe44c155250 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.286+0000 7fe433fff640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe43806c920 0x7fe43806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.286+0000 7fe433fff640 1 -- 172.21.15.84:0/2461710617 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fe43c08af50 con 0x7fe44c155250 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.286+0000 7fe4549ff740 1 Processor -- start 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.286+0000 7fe4549ff740 1 -- start start 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.287+0000 7fe44affd640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe43806c920 0x7fe43806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.287+0000 7fe44affd640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe43806c920 0x7fe43806ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe44c158b80 tx=0x7fe440007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.287+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.287+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 0x55ca3b8e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b8e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe4549ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca3b809f90 con 0x55ca3b8a4090 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca3b7a69d0 con 0x55ca3b8e55f0 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ca3b805f50 con 0x55ca3b8e59d0 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 0x55ca3b8e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b8e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 0x55ca3b8e5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59488/0 (socket says 172.21.15.84:59488) 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:54992/0 (socket says 172.21.15.84:54992) 2024-04-14T11:08:14.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b8e48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:60006/0 (socket says 172.21.15.84:60006) 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 -- 172.21.15.84:0/903126884 learned_addr learned my addr 172.21.15.84:0/903126884 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 -- 172.21.15.84:0/903126884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 msgr2=0x55ca3b8e48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b8e48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 -- 172.21.15.84:0/903126884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e55f0 msgr2=0x55ca3b8a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 -- 172.21.15.84:0/903126884 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3b5e8a20 con 0x55ca3b8a4090 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.288+0000 7fe44affd640 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 0x55ca3b8e5fb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe440001880 tx=0x7fe440012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58310bfa9751d29 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.289+0000 7fe4317fa640 1 -- 172.21.15.84:0/903126884 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440025070 con 0x55ca3b8a4090 2024-04-14T11:08:14.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.289+0000 7fe4317fa640 1 -- 172.21.15.84:0/903126884 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44001b050 con 0x55ca3b8a4090 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.289+0000 7fe4317fa640 1 -- 172.21.15.84:0/903126884 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440001d40 con 0x55ca3b8a4090 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.289+0000 7fe4549ff740 1 -- 172.21.15.84:0/903126884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 msgr2=0x55ca3b8e5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.289+0000 7fe4549ff740 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 0x55ca3b8e5fb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe440001880 tx=0x7fe440012000 comp rx=0 tx=0).stop 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 -- 172.21.15.84:0/903126884 shutdown_connections 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b8e48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8a4090 0x55ca3b8e5fb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 --2- 172.21.15.84:0/903126884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 -- 172.21.15.84:0/903126884 >> 172.21.15.84:0/903126884 conn(0x55ca3b8a1200 msgr2=0x55ca3b8a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 -- 172.21.15.84:0/903126884 shutdown_connections 2024-04-14T11:08:14.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.290+0000 7fe4549ff740 1 -- 172.21.15.84:0/903126884 wait complete. 2024-04-14T11:08:14.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.291+0000 7fe4549ff740 1 -- start start 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.291+0000 7fe4549ff740 1 Processor -- start 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.291+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8ec000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.291+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b89e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.291+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8f5a50 0x55ca3b8e0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe4549ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca3b7a4320 con 0x55ca3b8e55f0 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x55ca3b8ee920 con 0x55ca3b8f5a50 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x55ca3b8e9e70 con 0x55ca3b8e59d0 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe4549ff740 10 client.0 _ll_register_callbacks cb 0x55ca3b7c7150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44affd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b89e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8ec000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59500/0 (socket says 172.21.15.84:59500) 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44b7fe640 1 -- 172.21.15.84:0/3937919300 learned_addr learned my addr 172.21.15.84:0/3937919300 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44bfff640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8f5a50 0x55ca3b8e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44affd640 1 -- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8f5a50 msgr2=0x55ca3b8e0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44affd640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8f5a50 0x55ca3b8e0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44affd640 1 -- 172.21.15.84:0/3937919300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 msgr2=0x55ca3b8ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44affd640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44affd640 1 -- 172.21.15.84:0/3937919300 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3b6491b0 con 0x55ca3b8e59d0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.292+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe44affd640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b89e480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe440020000 tx=0x7fe440000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31f4aa48a412a19 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe42a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.175:3301/0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe42a7fc640 1 -- 172.21.15.84:0/3937919300 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440025030 con 0x55ca3b8e59d0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe42a7fc640 1 -- 172.21.15.84:0/3937919300 <== mon.2 v2:172.21.15.175:3301/0 2 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fe440010040 con 0x55ca3b8e59d0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe44001b050 con 0x55ca3b8e59d0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe42a7fc640 1 -- 172.21.15.84:0/3937919300 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fe440039050 con 0x55ca3b8e59d0 2024-04-14T11:08:14.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe4549ff740 10 client.4766 fetch_fsmap learned FSMap version 13 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55ca3b4dc310 con 0x55ca3b8e59d0 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe42a7fc640 1 -- 172.21.15.84:0/3937919300 <== mon.2 v2:172.21.15.175:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44001b050 con 0x55ca3b8e59d0 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe42a7fc640 1 -- 172.21.15.84:0/3937919300 <== mon.2 v2:172.21.15.175:3301/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fe44003c020 con 0x55ca3b8e59d0 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe4549ff740 10 client.4766 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe4549ff740 10 client.4766 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.293+0000 7fe4549ff740 20 client.4766 populate_metadata read hostname 'smithi084' 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.294+0000 7fe4549ff740 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8c98c0 0x55ca3b8c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.294+0000 7fe4549ff740 4 client.4766 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T11:08:14.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.294+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca3b8179b0 con 0x55ca3b8c98c0 2024-04-14T11:08:14.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.294+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8c98c0 0x55ca3b8c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.294+0000 7fe42a7fc640 10 client.4766 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:08:14.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.294+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8c98c0 0x55ca3b8c9cd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cc26d3f6e1bc411 server_cookie=b870a9e6f787acb in_seq=0 out_seq=0 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe42a7fc640 1 -- 172.21.15.84:0/3937919300 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ca3b8179b0 con 0x55ca3b8c98c0 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe42a7fc640 10 client.4766 handle_command_reply: tid=0 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe4549ff740 1 client.4766 shutdown 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 msgr2=0x55ca3b89e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe4549ff740 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b89e480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe440020000 tx=0x7fe440000ed0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 shutdown_connections 2024-04-14T11:08:14.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe4549ff740 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8c98c0 0x55ca3b8c9cd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe4549ff740 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8f5a50 0x55ca3b8e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.303+0000 7fe42a7fc640 0 client.4766 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.304+0000 7fe4549ff740 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b89e480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.304+0000 7fe4549ff740 1 --2- 172.21.15.84:0/3937919300 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b8ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.304+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 >> 172.21.15.84:0/3937919300 conn(0x55ca3b8a4090 msgr2=0x55ca3b89f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.304+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 shutdown_connections 2024-04-14T11:08:14.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.304+0000 7fe4549ff740 1 -- 172.21.15.84:0/3937919300 wait complete. 2024-04-14T11:08:14.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.304+0000 7fe4549ff740 20 client.4766 trim_cache size 0 max 16384 2024-04-14T11:08:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.322+0000 7fe4549ff740 1 Processor -- start 2024-04-14T11:08:14.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.322+0000 7fe4549ff740 1 -- start start 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b908dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b909300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe4549ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca3b8ec8d0 con 0x55ca3b8e55f0 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c0ad840 con 0x55ca3b8c98c0 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c0acaa0 con 0x55ca3b8e59d0 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe44affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b908dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe44affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b908dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59514/0 (socket says 172.21.15.84:59514) 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.323+0000 7fe44affd640 1 -- 172.21.15.84:0/831668551 learned_addr learned my addr 172.21.15.84:0/831668551 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44bfff640 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b909300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44affd640 1 -- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 msgr2=0x55ca3b909300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44affd640 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b909300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44affd640 1 -- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8c98c0 msgr2=0x55ca3b8a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44affd640 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44affd640 1 -- 172.21.15.84:0/831668551 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3b8a0fa0 con 0x55ca3b8e55f0 2024-04-14T11:08:14.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe44affd640 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b908dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe440001d60 tx=0x7fe44002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ffb9912fe38a46 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe430ff9640 1 -- 172.21.15.84:0/831668551 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440025020 con 0x55ca3b8e55f0 2024-04-14T11:08:14.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe430ff9640 1 -- 172.21.15.84:0/831668551 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44001b070 con 0x55ca3b8e55f0 2024-04-14T11:08:14.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.324+0000 7fe430ff9640 1 -- 172.21.15.84:0/831668551 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440020610 con 0x55ca3b8e55f0 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 -- 172.21.15.84:0/831668551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 msgr2=0x55ca3b908dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b908dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe440001d60 tx=0x7fe44002b000 comp rx=0 tx=0).stop 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 -- 172.21.15.84:0/831668551 shutdown_connections 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e59d0 0x55ca3b909300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8e55f0 0x55ca3b908dc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 --2- 172.21.15.84:0/831668551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 -- 172.21.15.84:0/831668551 >> 172.21.15.84:0/831668551 conn(0x55ca3b8a4090 msgr2=0x55ca3b8c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 -- 172.21.15.84:0/831668551 shutdown_connections 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 -- 172.21.15.84:0/831668551 wait complete. 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.325+0000 7fe4549ff740 1 -- start start 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe4549ff740 1 Processor -- start 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e55f0 0x55ca3b958680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe4549ff740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e59d0 0x55ca3b958bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe4549ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c0ab9a0 con 0x55ca3b8c98c0 2024-04-14T11:08:14.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe44c0ad170 con 0x55ca3b8e59d0 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.326+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe44c14a750 con 0x55ca3b8e55f0 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59516/0 (socket says 172.21.15.84:59516) 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 -- 172.21.15.84:0/270954201 learned_addr learned my addr 172.21.15.84:0/270954201 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 10 client.0 _ll_register_callbacks cb 0x7fe440023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44affd640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e55f0 0x55ca3b958680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44bfff640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e59d0 0x55ca3b958bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 -- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e55f0 msgr2=0x55ca3b958680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e55f0 0x55ca3b958680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 -- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e59d0 msgr2=0x55ca3b958bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e59d0 0x55ca3b958bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 -- 172.21.15.84:0/270954201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3b8ec220 con 0x55ca3b8c98c0 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe44b7fe640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a5270 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0588b0 tx=0x7fe43c089260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26929a6a2b658b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe42a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe42a7fc640 1 -- 172.21.15.84:0/270954201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c055220 con 0x55ca3b8c98c0 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe44001b070 con 0x55ca3b8c98c0 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe42a7fc640 1 -- 172.21.15.84:0/270954201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fe43c058000 con 0x55ca3b8c98c0 2024-04-14T11:08:14.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe42a7fc640 1 -- 172.21.15.84:0/270954201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fe43c07f050 con 0x55ca3b8c98c0 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 10 client.5154 fetch_fsmap learned FSMap version 13 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55ca3b95f380 con 0x55ca3b8c98c0 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe42a7fc640 1 -- 172.21.15.84:0/270954201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44001b070 con 0x55ca3b8c98c0 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe42a7fc640 1 -- 172.21.15.84:0/270954201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 13) ==== 4744+0+0 (secure 0 0 0) 0x7fe43c082020 con 0x55ca3b8c98c0 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 10 client.5154 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 10 client.5154 resolve_mds: validated gid 4308 aka daemon mds.b 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 20 client.5154 populate_metadata read hostname 'smithi084' 2024-04-14T11:08:14.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.327+0000 7fe4549ff740 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8f5a50 0x55ca3b961e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.328+0000 7fe4549ff740 4 client.5154 mds_command: new command op to 4308 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.328+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 --> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55ca3b811820 con 0x55ca3b8f5a50 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.328+0000 7fe44affd640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8f5a50 0x55ca3b961e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.328+0000 7fe42a7fc640 10 client.5154 ms_handle_connect on v2:172.21.15.175:6833/3381016657 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.328+0000 7fe44affd640 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8f5a50 0x55ca3b961e90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7830fa71ce8cb4b server_cookie=f9a76008d0c467 in_seq=0 out_seq=0 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe42a7fc640 1 -- 172.21.15.84:0/270954201 <== mds.0 v2:172.21.15.175:6833/3381016657 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55ca3b811820 con 0x55ca3b8f5a50 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe42a7fc640 10 client.5154 handle_command_reply: tid=0 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 client.5154 shutdown 2024-04-14T11:08:14.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 msgr2=0x55ca3b8a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a5270 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0588b0 tx=0x7fe43c089260 comp rx=0 tx=0).stop 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 shutdown_connections 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:6833/3381016657,v1:172.21.15.175:6835/3381016657] conn(0x55ca3b8f5a50 0x55ca3b961e90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ca3b8e59d0 0x55ca3b958bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ca3b8e55f0 0x55ca3b958680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe42a7fc640 0 client.5154 ms_handle_reset on v2:172.21.15.175:6833/3381016657 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 --2- 172.21.15.84:0/270954201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca3b8c98c0 0x55ca3b8a5270 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.329+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 >> 172.21.15.84:0/270954201 conn(0x55ca3b8a4090 msgr2=0x55ca3b8c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 shutdown_connections 2024-04-14T11:08:14.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe4549ff740 1 -- 172.21.15.84:0/270954201 wait complete. 2024-04-14T11:08:14.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe4549ff740 20 client.5154 trim_cache size 0 max 16384 2024-04-14T11:08:14.329 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-04-14T11:08:14.329 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 13, 2024-04-14T11:08:14.329 INFO:teuthology.orchestra.run.smithi084.stdout: "leader": 4308, 2024-04-14T11:08:14.330 INFO:teuthology.orchestra.run.smithi084.stdout: "set_version": 10, 2024-04-14T11:08:14.330 INFO:teuthology.orchestra.run.smithi084.stdout: "sets": {} 2024-04-14T11:08:14.330 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-04-14T11:08:14.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe43806c920 msgr2=0x7fe43806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe43806c920 0x7fe43806ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe44c158b80 tx=0x7fe440007b70 comp rx=0 tx=0).stop 2024-04-14T11:08:14.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 msgr2=0x7fe44c14f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 0x7fe44c14f6c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00c3c0 tx=0x7fe43c00c880 comp rx=0 tx=0).stop 2024-04-14T11:08:14.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 shutdown_connections 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe43806c920 0x7fe43806ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe44c15ef30 0x7fe44c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe44c15eaf0 0x7fe44c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 --2- 172.21.15.84:0/2461710617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe44c155250 0x7fe44c14f6c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.330+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 >> 172.21.15.84:0/2461710617 conn(0x7fe44c067b40 msgr2=0x7fe44c158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.331+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 shutdown_connections 2024-04-14T11:08:14.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.331+0000 7fe451c0f640 1 -- 172.21.15.84:0/2461710617 wait complete. 2024-04-14T11:08:14.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.336+0000 7f71703f0640 1 Processor -- start 2024-04-14T11:08:14.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.336+0000 7f71703f0640 1 -- start start 2024-04-14T11:08:14.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f71703f0640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71680c7120 0x7f71680730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f71703f0640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71680c4bc0 con 0x7f7168151e20 2024-04-14T11:08:14.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f71703f0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71680c4ea0 con 0x7f716806b900 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f71703f0640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f71680c4970 con 0x7f71680c7120 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f716e98d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71680c7120 0x7f71680730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f716d98b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f716806b900 0x7f7168072990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:36824/0 (socket says 172.21.15.84:36824) 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f716e98d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f71680c7120 0x7f71680730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59520/0 (socket says 172.21.15.84:59520) 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.337+0000 7f716e98d640 1 -- 172.21.15.84:0/2904243836 learned_addr learned my addr 172.21.15.84:0/2904243836 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.338+0000 7f716d18a640 1 -- 172.21.15.84:0/2904243836 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394978574 0 0) 0x7f71680c4ea0 con 0x7f716806b900 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.338+0000 7f716d18a640 1 -- 172.21.15.84:0/2904243836 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7154005730 con 0x7f716806b900 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.338+0000 7f716d18a640 1 -- 172.21.15.84:0/2904243836 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257617743 0 0) 0x7f71680c4bc0 con 0x7f7168151e20 2024-04-14T11:08:14.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.338+0000 7f716e98d640 1 -- 172.21.15.84:0/2904243836 >> v1:172.21.15.175:6789/0 conn(0x7f716806b900 legacy=0x7f7168072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.338+0000 7f716e98d640 1 -- 172.21.15.84:0/2904243836 >> v1:172.21.15.84:6789/0 conn(0x7f7168151e20 legacy=0x7f71681584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.338+0000 7f716e98d640 1 -- 172.21.15.84:0/2904243836 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7168157cf0 con 0x7f71680c7120 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.339+0000 7f716e98d640 1 --2- 172.21.15.84:0/2904243836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71680c7120 0x7f71680730a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f71680c4af0 tx=0x7f716002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661406f4415a8f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.339+0000 7f716d18a640 1 -- 172.21.15.84:0/2904243836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716002cb90 con 0x7f71680c7120 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.339+0000 7f716d18a640 1 -- 172.21.15.84:0/2904243836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716002cd30 con 0x7f71680c7120 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.339+0000 7f716d18a640 1 -- 172.21.15.84:0/2904243836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7160034610 con 0x7f71680c7120 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 -- 172.21.15.84:0/2904243836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71680c7120 msgr2=0x7f71680730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 --2- 172.21.15.84:0/2904243836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71680c7120 0x7f71680730a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f71680c4af0 tx=0x7f716002bff0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 -- 172.21.15.84:0/2904243836 shutdown_connections 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 --2- 172.21.15.84:0/2904243836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71680c7120 0x7f71680730a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 -- 172.21.15.84:0/2904243836 >> 172.21.15.84:0/2904243836 conn(0x7f71680c9f70 msgr2=0x7f71680ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 -- 172.21.15.84:0/2904243836 shutdown_connections 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.340+0000 7f71703f0640 1 -- 172.21.15.84:0/2904243836 wait complete. 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.341+0000 7f71703f0640 1 Processor -- start 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.341+0000 7f71703f0640 1 -- start start 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f71703f0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f716806b900 0x7f7168156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f71703f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680c7120 0x7f716806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f71703f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 0x7f71680c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f71703f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7168152200 con 0x7f7168151e20 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f71703f0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71680735e0 con 0x7f71680c7120 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f71703f0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f716806cdf0 con 0x7f716806b900 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716e98d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 0x7f71680c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716e98d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 0x7f71680c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59532/0 (socket says 172.21.15.84:59532) 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716d98b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680c7120 0x7f716806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716e98d640 1 -- 172.21.15.84:0/2361457660 learned_addr learned my addr 172.21.15.84:0/2361457660 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716e18c640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f716806b900 0x7f7168156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716d98b640 1 -- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f716806b900 msgr2=0x7f7168156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716d98b640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f716806b900 0x7f7168156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716d98b640 1 -- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 msgr2=0x7f71680c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.342+0000 7f716d98b640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 0x7f71680c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f716d98b640 1 -- 172.21.15.84:0/2361457660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71681568a0 con 0x7f71680c7120 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f716e98d640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 0x7f71680c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f716e18c640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f716806b900 0x7f7168156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:14.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f716d98b640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680c7120 0x7f716806bfc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f716806bd20 tx=0x7f715800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71580074e0 con 0x7f71680c7120 2024-04-14T11:08:14.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7158007680 con 0x7f71680c7120 2024-04-14T11:08:14.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158004a00 con 0x7f71680c7120 2024-04-14T11:08:14.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7168142df0 con 0x7f71680c7120 2024-04-14T11:08:14.343 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 294, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 247, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) 2024-04-14T11:08:14.348 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-14T11:08:14.357 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-14T11:08:14.357 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T11:08:14.358 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T11:08:14.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.343+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681efd30 con 0x7f71680c7120 2024-04-14T11:08:14.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.344+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7168069b20 con 0x7f71680c7120 2024-04-14T11:08:14.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.345+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f715801a020 con 0x7f71680c7120 2024-04-14T11:08:14.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.345+0000 7f715effd640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f714c06c8f0 0x7f714c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.345+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f715808b2d0 con 0x7f71680c7120 2024-04-14T11:08:14.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.345+0000 7f716e18c640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f714c06c8f0 0x7f714c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.346+0000 7f716e18c640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f714c06c8f0 0x7f714c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f60 tx=0x7f7164009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.350+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f71681568a0 con 0x7f71680c7120 2024-04-14T11:08:14.375 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T11:08:14.375 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T11:08:14.430 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T11:08:14.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.536+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7168073a70 con 0x7f71680c7120 2024-04-14T11:08:14.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.536+0000 7f715effd640 1 -- 172.21.15.84:0/2361457660 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7f7158007e20 con 0x7f71680c7120 2024-04-14T11:08:14.527 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T11:08:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f714c06c8f0 msgr2=0x7f714c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f714c06c8f0 0x7f714c06edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f60 tx=0x7f7164009040 comp rx=0 tx=0).stop 2024-04-14T11:08:14.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680c7120 msgr2=0x7f716806bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680c7120 0x7f716806bfc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f716806bd20 tx=0x7f715800c890 comp rx=0 tx=0).stop 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 shutdown_connections 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f714c06c8f0 0x7f714c06edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7168151e20 0x7f71680c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71680c7120 0x7f716806bfc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 --2- 172.21.15.84:0/2361457660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f716806b900 0x7f7168156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 >> 172.21.15.84:0/2361457660 conn(0x7f71680c9f70 msgr2=0x7f716814f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 shutdown_connections 2024-04-14T11:08:14.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.539+0000 7f71703f0640 1 -- 172.21.15.84:0/2361457660 wait complete. 2024-04-14T11:08:14.541 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T11:08:14.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.583+0000 7f7cfe836640 1 Processor -- start 2024-04-14T11:08:14.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.583+0000 7f7cfe836640 1 -- start start 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cfe836640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf8072c10 0x7f7cf80c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cfe836640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf8157a70 con 0x7f7cf80c4eb0 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cfe836640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf80c68d0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cfe836640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf80c7450 con 0x7f7cf8072c10 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf77fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f7cf80c4eb0 0x7f7cf815b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53908/0 (socket says 172.21.15.84:53908) 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf77fe640 1 -- 172.21.15.84:0/1202917677 learned_addr learned my addr 172.21.15.84:0/1202917677 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf7fff640 1 --2- 172.21.15.84:0/1202917677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf8072c10 0x7f7cf80c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862075082 0 0) 0x7f7cf8157a70 con 0x7f7cf80c4eb0 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce0003520 con 0x7f7cf80c4eb0 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342477456 0 0) 0x7f7cf80c68d0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf8157a70 con 0x7f7cf8072ff0 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf7fff640 1 -- 172.21.15.84:0/1202917677 >> v1:172.21.15.175:6789/0 conn(0x7f7cf8072ff0 legacy=0x7f7cf81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf7fff640 1 -- 172.21.15.84:0/1202917677 >> v1:172.21.15.84:6789/0 conn(0x7f7cf80c4eb0 legacy=0x7f7cf815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.584+0000 7f7cf7fff640 1 -- 172.21.15.84:0/1202917677 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf80c6bb0 con 0x7f7cf8072c10 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.585+0000 7f7cf7fff640 1 --2- 172.21.15.84:0/1202917677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf8072c10 0x7f7cf80c4970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097d0 tx=0x7f7cec02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4a7c17e90847090 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.585+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec034070 con 0x7f7cf8072c10 2024-04-14T11:08:14.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.585+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec030880 con 0x7f7cf8072c10 2024-04-14T11:08:14.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.585+0000 7f7cf6ffd640 1 -- 172.21.15.84:0/1202917677 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec030c30 con 0x7f7cf8072c10 2024-04-14T11:08:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 -- 172.21.15.84:0/1202917677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf8072c10 msgr2=0x7f7cf80c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 --2- 172.21.15.84:0/1202917677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf8072c10 0x7f7cf80c4970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097d0 tx=0x7f7cec02b9c0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 -- 172.21.15.84:0/1202917677 shutdown_connections 2024-04-14T11:08:14.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 --2- 172.21.15.84:0/1202917677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf8072c10 0x7f7cf80c4970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 -- 172.21.15.84:0/1202917677 >> 172.21.15.84:0/1202917677 conn(0x7f7cf80cdc60 msgr2=0x7f7cf80c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 -- 172.21.15.84:0/1202917677 shutdown_connections 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.586+0000 7f7cfe836640 1 -- 172.21.15.84:0/1202917677 wait complete. 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.587+0000 7f7cfe836640 1 Processor -- start 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.587+0000 7f7cfe836640 1 -- start start 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfe836640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cf8072c10 0x7f7cf8150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfe836640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 0x7f7cf8067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfe836640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf80c4eb0 0x7f7cf80cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfe836640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf815bd70 con 0x7f7cf8072ff0 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfe836640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf80c7170 con 0x7f7cf8072c10 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfe836640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf815bef0 con 0x7f7cf80c4eb0 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 0x7f7cf8067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 0x7f7cf8067990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59536/0 (socket says 172.21.15.84:59536) 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 -- 172.21.15.84:0/746535523 learned_addr learned my addr 172.21.15.84:0/746535523 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf7fff640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cf8072c10 0x7f7cf8150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cfcdd3640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf80c4eb0 0x7f7cf80cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 -- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf80c4eb0 msgr2=0x7f7cf80cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf80c4eb0 0x7f7cf80cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 -- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cf8072c10 msgr2=0x7f7cf8150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cf8072c10 0x7f7cf8150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.588+0000 7f7cf77fe640 1 -- 172.21.15.84:0/746535523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf81eead0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.589+0000 7f7cf77fe640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 0x7f7cf8067990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c430 tx=0x7f7ce800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.589+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8017070 con 0x7f7cf8072ff0 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.589+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8005da0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.589+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf81eedb0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.589+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8007310 con 0x7f7cf8072ff0 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.589+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf81ef370 con 0x7f7cf8072ff0 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.590+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf8156110 con 0x7f7cf8072ff0 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.590+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ce801a070 con 0x7f7cf8072ff0 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.590+0000 7f7cf4ff9640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7ce406c8f0 0x7f7ce406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.591+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f7ce808af00 con 0x7f7cf8072ff0 2024-04-14T11:08:14.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.591+0000 7f7cf7fff640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7ce406c8f0 0x7f7ce406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.591+0000 7f7cf7fff640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7ce406c8f0 0x7f7ce406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7cec036000 tx=0x7f7cec03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.595+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f7cf8156110 con 0x7f7cf8072ff0 2024-04-14T11:08:14.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.654+0000 7f054d4de640 1 Processor -- start 2024-04-14T11:08:14.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.654+0000 7f054d4de640 1 -- start start 2024-04-14T11:08:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f054d4de640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05480c7490 0x7f054815b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f054d4de640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054815e630 con 0x7f05480c7870 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f054d4de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054815e910 con 0x7f05480c98b0 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f054d4de640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f054815bc40 con 0x7f05480c7490 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f0546ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05480c7490 0x7f054815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f053ffff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f05480c7870 0x7f05480c91a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53918/0 (socket says 172.21.15.84:53918) 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f0546ffd640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f05480c7490 0x7f054815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59552/0 (socket says 172.21.15.84:59552) 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.655+0000 7f053ffff640 1 -- 172.21.15.84:0/2412291367 learned_addr learned my addr 172.21.15.84:0/2412291367 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.656+0000 7f0546ffd640 1 -- 172.21.15.84:0/2412291367 >> v1:172.21.15.175:6789/0 conn(0x7f05480c98b0 legacy=0x7f0548154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.656+0000 7f0546ffd640 1 -- 172.21.15.84:0/2412291367 >> v1:172.21.15.84:6789/0 conn(0x7f05480c7870 legacy=0x7f05480c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.656+0000 7f05467fc640 1 -- 172.21.15.84:0/2412291367 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911121652 0 0) 0x7f054815e910 con 0x7f05480c98b0 2024-04-14T11:08:14.648 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.656+0000 7f0546ffd640 1 -- 172.21.15.84:0/2412291367 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054815ebf0 con 0x7f05480c7490 2024-04-14T11:08:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.656+0000 7f0546ffd640 1 --2- 172.21.15.84:0/2412291367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c7490 0x7f054815b700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f05380097a0 tx=0x7f053802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5623dc45404819c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f05467fc640 1 -- 172.21.15.84:0/2412291367 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538038070 con 0x7f05480c7490 2024-04-14T11:08:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f05467fc640 1 -- 172.21.15.84:0/2412291367 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0538031700 con 0x7f05480c7490 2024-04-14T11:08:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f05467fc640 1 -- 172.21.15.84:0/2412291367 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538031ad0 con 0x7f05480c7490 2024-04-14T11:08:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f054d4de640 1 -- 172.21.15.84:0/2412291367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c7490 msgr2=0x7f054815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f054d4de640 1 --2- 172.21.15.84:0/2412291367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c7490 0x7f054815b700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f05380097a0 tx=0x7f053802b820 comp rx=0 tx=0).stop 2024-04-14T11:08:14.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f054d4de640 1 -- 172.21.15.84:0/2412291367 shutdown_connections 2024-04-14T11:08:14.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.657+0000 7f054d4de640 1 --2- 172.21.15.84:0/2412291367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c7490 0x7f054815b700 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.658+0000 7f054d4de640 1 -- 172.21.15.84:0/2412291367 >> 172.21.15.84:0/2412291367 conn(0x7f054806b900 msgr2=0x7f054806bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.658+0000 7f054d4de640 1 -- 172.21.15.84:0/2412291367 shutdown_connections 2024-04-14T11:08:14.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.658+0000 7f054d4de640 1 -- 172.21.15.84:0/2412291367 wait complete. 2024-04-14T11:08:14.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.659+0000 7f054d4de640 1 Processor -- start 2024-04-14T11:08:14.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.659+0000 7f054d4de640 1 -- start start 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.660+0000 7f054d4de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05480c7490 0x7f05481e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05480c7870 0x7f054814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 0x7f054814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f054815e1f0 con 0x7f05480c98b0 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05480c8c80 con 0x7f05480c7490 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f054815e370 con 0x7f05480c7870 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 0x7f054814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f0546ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05480c7490 0x7f05481e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 0x7f054814f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59558/0 (socket says 172.21.15.84:59558) 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 -- 172.21.15.84:0/2269246430 learned_addr learned my addr 172.21.15.84:0/2269246430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f053ffff640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05480c7870 0x7f054814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 -- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05480c7870 msgr2=0x7f054814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05480c7870 0x7f054814d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 -- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05480c7490 msgr2=0x7f05481e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05480c7490 0x7f05481e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 -- 172.21.15.84:0/2269246430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05481f19a0 con 0x7f05480c98b0 2024-04-14T11:08:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f0546ffd640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05480c7490 0x7f05481e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f05477fe640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 0x7f054814f590 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f054000c7b0 tx=0x7f054000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540003ba0 con 0x7f05480c98b0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540003d40 con 0x7f05480c98b0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540005270 con 0x7f05480c98b0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0548150b40 con 0x7f05480c98b0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.661+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054814e7d0 con 0x7f05480c98b0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.662+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0548069b20 con 0x7f05480c98b0 2024-04-14T11:08:14.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.663+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0540005410 con 0x7f05480c98b0 2024-04-14T11:08:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.663+0000 7f053f7fe640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f052806c920 0x7f052806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.663+0000 7f0546ffd640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f052806c920 0x7f052806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.663+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f054008b980 con 0x7f05480c98b0 2024-04-14T11:08:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.664+0000 7f0546ffd640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f052806c920 0x7f052806ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0538035000 tx=0x7f0538008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.668+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f0540059670 con 0x7f05480c98b0 2024-04-14T11:08:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.782+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cf80c68d0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.783+0000 7f7cf4ff9640 1 -- 172.21.15.84:0/746535523 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17039 (secure 0 0 0) 0x7f7cf80c68d0 con 0x7f7cf8072ff0 2024-04-14T11:08:14.774 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:14.774 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T11:01:54.049114+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2c","mappings":[{"from":4,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":504,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T11:08:14.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7ce406c8f0 msgr2=0x7f7ce406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7ce406c8f0 0x7f7ce406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7cec036000 tx=0x7f7cec03b040 comp rx=0 tx=0).stop 2024-04-14T11:08:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 msgr2=0x7f7cf8067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 0x7f7cf8067990 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c430 tx=0x7f7ce800c8f0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 shutdown_connections 2024-04-14T11:08:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f7ce406c8f0 0x7f7ce406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cf80c4eb0 0x7f7cf80cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7cf8072ff0 0x7f7cf8067990 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 --2- 172.21.15.84:0/746535523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cf8072c10 0x7f7cf8150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 >> 172.21.15.84:0/746535523 conn(0x7f7cf80cdc60 msgr2=0x7f7cf8155a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 shutdown_connections 2024-04-14T11:08:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.785+0000 7f7cfe836640 1 -- 172.21.15.84:0/746535523 wait complete. 2024-04-14T11:08:14.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T11:08:14.787 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T11:08:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.862+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f054815acf0 con 0x7f05480c98b0 2024-04-14T11:08:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.863+0000 7f053f7fe640 1 -- 172.21.15.84:0/2269246430 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f054005d970 con 0x7f05480c98b0 2024-04-14T11:08:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-04-14T11:08:14.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f052806c920 msgr2=0x7f052806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f052806c920 0x7f052806ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0538035000 tx=0x7f0538008030 comp rx=0 tx=0).stop 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 msgr2=0x7f054814f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 0x7f054814f590 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f054000c7b0 tx=0x7f054000cbb0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 shutdown_connections 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f052806c920 0x7f052806ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f05480c98b0 0x7f054814f590 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05480c7870 0x7f054814d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 --2- 172.21.15.84:0/2269246430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05480c7490 0x7f05481e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 >> 172.21.15.84:0/2269246430 conn(0x7f054806b900 msgr2=0x7f054806bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 shutdown_connections 2024-04-14T11:08:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.865+0000 7f054d4de640 1 -- 172.21.15.84:0/2269246430 wait complete. 2024-04-14T11:08:14.867 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T11:08:14.867 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T11:08:14.922 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T11:08:14.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.942+0000 7fe3309bb640 1 Processor -- start 2024-04-14T11:08:14.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.942+0000 7fe3309bb640 1 -- start start 2024-04-14T11:08:14.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe3309bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c155130 0x7fe32c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe3309bb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32c15f2d0 con 0x7fe32c0b62e0 2024-04-14T11:08:14.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe3309bb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32c0b6750 con 0x7fe32c0cce20 2024-04-14T11:08:14.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe3309bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c15e470 con 0x7fe32c155130 2024-04-14T11:08:14.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe32ad9d640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe32c0b62e0 0x7fe32c15b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53924/0 (socket says 172.21.15.84:53924) 2024-04-14T11:08:14.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe32ad9d640 1 -- 172.21.15.84:0/1948660660 learned_addr learned my addr 172.21.15.84:0/1948660660 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:14.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe32a59c640 1 --2- 172.21.15.84:0/1948660660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c155130 0x7fe32c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467460686 0 0) 0x7fe32c15f2d0 con 0x7fe32c0b62e0 2024-04-14T11:08:14.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe318003520 con 0x7fe32c0b62e0 2024-04-14T11:08:14.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022016474 0 0) 0x7fe32c0b6750 con 0x7fe32c0cce20 2024-04-14T11:08:14.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c15f2d0 con 0x7fe32c0cce20 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe32a59c640 1 -- 172.21.15.84:0/1948660660 >> v1:172.21.15.175:6789/0 conn(0x7fe32c0cce20 legacy=0x7fe32c0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe32a59c640 1 -- 172.21.15.84:0/1948660660 >> v1:172.21.15.84:6789/0 conn(0x7fe32c0b62e0 legacy=0x7fe32c15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 <== mon.0 v1:172.21.15.84:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2692795869 0 0) 0x7fe318003520 con 0x7fe32c0b62e0 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.943+0000 7fe32a59c640 1 -- 172.21.15.84:0/1948660660 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c15e750 con 0x7fe32c155130 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.944+0000 7fe32a59c640 1 --2- 172.21.15.84:0/1948660660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c155130 0x7fe32c0cc190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0097d0 tx=0x7fe31c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26255977a394ad78 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.944+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3240019f0 con 0x7fe32c155130 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.944+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c037070 con 0x7fe32c155130 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.944+0000 7fe329d9b640 1 -- 172.21.15.84:0/1948660660 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c031780 con 0x7fe32c155130 2024-04-14T11:08:14.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 -- 172.21.15.84:0/1948660660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c155130 msgr2=0x7fe32c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 --2- 172.21.15.84:0/1948660660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c155130 0x7fe32c0cc190 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0097d0 tx=0x7fe31c02b8a0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 -- 172.21.15.84:0/1948660660 shutdown_connections 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 --2- 172.21.15.84:0/1948660660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c155130 0x7fe32c0cc190 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 -- 172.21.15.84:0/1948660660 >> 172.21.15.84:0/1948660660 conn(0x7fe32c0d07b0 msgr2=0x7fe32c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 -- 172.21.15.84:0/1948660660 shutdown_connections 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.945+0000 7fe3309bb640 1 -- 172.21.15.84:0/1948660660 wait complete. 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.946+0000 7fe3309bb640 1 Processor -- start 2024-04-14T11:08:14.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.946+0000 7fe3309bb640 1 -- start start 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe3309bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe32c0b62e0 0x7fe32c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe3309bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c0cce20 0x7fe32c1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe3309bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c155130 0x7fe32c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe3309bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c15eff0 con 0x7fe32c155130 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe3309bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe32c15ed10 con 0x7fe32c0b62e0 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe3309bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe32c155510 con 0x7fe32c0cce20 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe32ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c155130 0x7fe32c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe32ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c155130 0x7fe32c14eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59566/0 (socket says 172.21.15.84:59566) 2024-04-14T11:08:14.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe32ad9d640 1 -- 172.21.15.84:0/3251303709 learned_addr learned my addr 172.21.15.84:0/3251303709 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe32a59c640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe32c0b62e0 0x7fe32c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe321d9b640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c0cce20 0x7fe32c1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe32a59c640 1 -- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c0cce20 msgr2=0x7fe32c1f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.947+0000 7fe32a59c640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c0cce20 0x7fe32c1f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe32a59c640 1 -- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c155130 msgr2=0x7fe32c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe32a59c640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c155130 0x7fe32c14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe32a59c640 1 -- 172.21.15.84:0/3251303709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32c1f1810 con 0x7fe32c0b62e0 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe321d9b640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c0cce20 0x7fe32c1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:14.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe32a59c640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe32c0b62e0 0x7fe32c14cfb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe31c033000 tx=0x7fe31c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c032610 con 0x7fe32c0b62e0 2024-04-14T11:08:14.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c0327b0 con 0x7fe32c0b62e0 2024-04-14T11:08:14.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32c15de40 con 0x7fe32c0b62e0 2024-04-14T11:08:14.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c032b60 con 0x7fe32c0b62e0 2024-04-14T11:08:14.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.948+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32c1f0d30 con 0x7fe32c0b62e0 2024-04-14T11:08:14.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.949+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32c069b20 con 0x7fe32c0b62e0 2024-04-14T11:08:14.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.949+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe31c04c060 con 0x7fe32c0b62e0 2024-04-14T11:08:14.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.950+0000 7fe3237fe640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe30c06c8f0 0x7fe30c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:14.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.950+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fe31c0ad510 con 0x7fe32c0b62e0 2024-04-14T11:08:14.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.950+0000 7fe321d9b640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe30c06c8f0 0x7fe30c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:14.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.950+0000 7fe321d9b640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe30c06c8f0 0x7fe30c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cbc90 tx=0x7fe314009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:14.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:14.954+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fe31c040070 con 0x7fe32c0b62e0 2024-04-14T11:08:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.043+0000 7f1deb3bb640 1 Processor -- start 2024-04-14T11:08:15.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.043+0000 7f1deb3bb640 1 -- start start 2024-04-14T11:08:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1deb3bb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1de4152d60 0x7f1de415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1deb3bb640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de415d000 con 0x7f1de40c44d0 2024-04-14T11:08:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1deb3bb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1de40c3ad0 con 0x7f1de40b42d0 2024-04-14T11:08:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1deb3bb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1de4071070 con 0x7f1de4152d60 2024-04-14T11:08:15.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1de9958640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f1de40c44d0 0x7f1de406fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53938/0 (socket says 172.21.15.84:53938) 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1de9958640 1 -- 172.21.15.84:0/2684947870 learned_addr learned my addr 172.21.15.84:0/2684947870 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.044+0000 7f1de9157640 1 --2- 172.21.15.84:0/2684947870 >> v2:172.21.15.175:3300/0 conn(0x7f1de4152d60 0x7f1de415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946028005 0 0) 0x7f1de415d000 con 0x7f1de40c44d0 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd0003520 con 0x7f1de40c44d0 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614338283 0 0) 0x7f1de40c3ad0 con 0x7f1de40b42d0 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de415d000 con 0x7f1de40b42d0 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1de9157640 1 -- 172.21.15.84:0/2684947870 >> v1:172.21.15.175:6789/0 conn(0x7f1de40b42d0 legacy=0x7f1de40c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.037 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1de9157640 1 -- 172.21.15.84:0/2684947870 >> v1:172.21.15.84:6789/0 conn(0x7f1de40c44d0 legacy=0x7f1de406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.045+0000 7f1de9157640 1 -- 172.21.15.84:0/2684947870 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de40c8e90 con 0x7f1de4152d60 2024-04-14T11:08:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1de9157640 1 --2- 172.21.15.84:0/2684947870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de4152d60 0x7f1de415cac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80097a0 tx=0x7f1dd802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9deae608599f457c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8035020 con 0x7f1de4152d60 2024-04-14T11:08:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd8031830 con 0x7f1de4152d60 2024-04-14T11:08:15.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1dd7fff640 1 -- 172.21.15.84:0/2684947870 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8031c00 con 0x7f1de4152d60 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2684947870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de4152d60 msgr2=0x7f1de415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2684947870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de4152d60 0x7f1de415cac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80097a0 tx=0x7f1dd802b8d0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2684947870 shutdown_connections 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2684947870 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de4152d60 0x7f1de415cac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2684947870 >> 172.21.15.84:0/2684947870 conn(0x7f1de4071590 msgr2=0x7f1de4071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2684947870 shutdown_connections 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.046+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2684947870 wait complete. 2024-04-14T11:08:15.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.047+0000 7f1deb3bb640 1 Processor -- start 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.047+0000 7f1deb3bb640 1 -- start start 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1deb3bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de40b42d0 0x7f1de414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1deb3bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1de4152d60 0x7f1de41f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1deb3bb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 0x7f1de415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1deb3bb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1de406f900 con 0x7f1de415ca80 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1deb3bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1de40c3550 con 0x7f1de40b42d0 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1deb3bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1de40c37f0 con 0x7f1de4152d60 2024-04-14T11:08:15.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1de9958640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 0x7f1de415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1de9958640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 0x7f1de415bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59568/0 (socket says 172.21.15.84:59568) 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1de9958640 1 -- 172.21.15.84:0/2311894236 learned_addr learned my addr 172.21.15.84:0/2311894236 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1de9157640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de40b42d0 0x7f1de414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.048+0000 7f1de8956640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1de4152d60 0x7f1de41f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1de9958640 1 -- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1de4152d60 msgr2=0x7f1de41f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1de9958640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1de4152d60 0x7f1de41f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1de9958640 1 -- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de40b42d0 msgr2=0x7f1de414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1de9958640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de40b42d0 0x7f1de414e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1de9958640 1 -- 172.21.15.84:0/2311894236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de41597c0 con 0x7f1de415ca80 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1de9958640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 0x7f1de415bb60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00cba0 tx=0x7f1ddc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc017070 con 0x7f1de415ca80 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00ace0 con 0x7f1de415ca80 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc012620 con 0x7f1de415ca80 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de41f07f0 con 0x7f1de415ca80 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.049+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de415a100 con 0x7f1de415ca80 2024-04-14T11:08:15.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.050+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1de4069c30 con 0x7f1de415ca80 2024-04-14T11:08:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.050+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ddc01a070 con 0x7f1de415ca80 2024-04-14T11:08:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.051+0000 7f1dd5ffb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1dc806c8f0 0x7f1dc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.051+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f1ddc08bac0 con 0x7f1de415ca80 2024-04-14T11:08:15.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.051+0000 7f1de9157640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1dc806c8f0 0x7f1dc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.051+0000 7f1de9157640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1dc806c8f0 0x7f1dc806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8036000 tx=0x7f1dd803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.060+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f1de41597c0 con 0x7f1de415ca80 2024-04-14T11:08:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.141+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe32c1594c0 con 0x7fe32c0b62e0 2024-04-14T11:08:15.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.142+0000 7fe3237fe640 1 -- 172.21.15.84:0/3251303709 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fe31c02f050 con 0x7fe32c0b62e0 2024-04-14T11:08:15.133 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T11:08:15.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe30c06c8f0 msgr2=0x7fe30c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe30c06c8f0 0x7fe30c06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cbc90 tx=0x7fe314009040 comp rx=0 tx=0).stop 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe32c0b62e0 msgr2=0x7fe32c14cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe32c0b62e0 0x7fe32c14cfb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe31c033000 tx=0x7fe31c0046c0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 shutdown_connections 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe30c06c8f0 0x7fe30c06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe32c155130 0x7fe32c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe32c0cce20 0x7fe32c1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 --2- 172.21.15.84:0/3251303709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe32c0b62e0 0x7fe32c14cfb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 >> 172.21.15.84:0/3251303709 conn(0x7fe32c0d07b0 msgr2=0x7fe32c14fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 shutdown_connections 2024-04-14T11:08:15.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.145+0000 7fe3309bb640 1 -- 172.21.15.84:0/3251303709 wait complete. 2024-04-14T11:08:15.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T11:08:15.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.249+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1de41599a0 con 0x7f1de415ca80 2024-04-14T11:08:15.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.250+0000 7f1dd5ffb640 1 -- 172.21.15.84:0/2311894236 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17039 (secure 0 0 0) 0x7f1ddc0596a0 con 0x7f1de415ca80 2024-04-14T11:08:15.242 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:15.242 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T11:01:54.049114+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2c","mappings":[{"from":4,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":504,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T11:08:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1dc806c8f0 msgr2=0x7f1dc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1dc806c8f0 0x7f1dc806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8036000 tx=0x7f1dd803c040 comp rx=0 tx=0).stop 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 msgr2=0x7f1de415bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 0x7f1de415bb60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc00cba0 tx=0x7f1ddc00a430 comp rx=0 tx=0).stop 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 shutdown_connections 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f1dc806c8f0 0x7f1dc806edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1de415ca80 0x7f1de415bb60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1de4152d60 0x7f1de41f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 --2- 172.21.15.84:0/2311894236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1de40b42d0 0x7f1de414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 >> 172.21.15.84:0/2311894236 conn(0x7f1de4071590 msgr2=0x7f1de406d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 shutdown_connections 2024-04-14T11:08:15.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.252+0000 7f1deb3bb640 1 -- 172.21.15.84:0/2311894236 wait complete. 2024-04-14T11:08:15.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T11:08:15.255 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T11:08:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.305+0000 7fe749cb7640 1 Processor -- start 2024-04-14T11:08:15.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.305+0000 7fe749cb7640 1 -- start start 2024-04-14T11:08:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe749cb7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe744151d90 0x7fe744157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe749cb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe7440c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe749cb7640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74415b110 con 0x7fe7440c44e0 2024-04-14T11:08:15.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe749cb7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe74415b380 con 0x7fe744151d90 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe749cb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe74415b660 con 0x7fe7440c7f50 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe743fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fe7440c44e0 0x7fe744072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53948/0 (socket says 172.21.15.84:53948) 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe743fff640 1 -- 172.21.15.84:0/2963156013 learned_addr learned my addr 172.21.15.84:0/2963156013 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe7437fe640 1 --2- 172.21.15.84:0/2963156013 >> v2:172.21.15.175:3300/0 conn(0x7fe744151d90 0x7fe744157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.306+0000 7fe742ffd640 1 --2- 172.21.15.84:0/2963156013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe7440c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe7427fc640 1 -- 172.21.15.84:0/2963156013 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668329750 0 0) 0x7fe74415b110 con 0x7fe7440c44e0 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe7427fc640 1 -- 172.21.15.84:0/2963156013 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe72c003520 con 0x7fe7440c44e0 2024-04-14T11:08:15.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe742ffd640 1 -- 172.21.15.84:0/2963156013 >> v2:172.21.15.175:3300/0 conn(0x7fe744151d90 msgr2=0x7fe744157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe742ffd640 1 --2- 172.21.15.84:0/2963156013 >> v2:172.21.15.175:3300/0 conn(0x7fe744151d90 0x7fe744157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe742ffd640 1 -- 172.21.15.84:0/2963156013 >> v1:172.21.15.84:6789/0 conn(0x7fe7440c44e0 legacy=0x7fe744072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe742ffd640 1 -- 172.21.15.84:0/2963156013 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74415b940 con 0x7fe7440c7f50 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.307+0000 7fe7437fe640 1 --2- 172.21.15.84:0/2963156013 >> v2:172.21.15.175:3300/0 conn(0x7fe744151d90 0x7fe744157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe742ffd640 1 --2- 172.21.15.84:0/2963156013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe7440c4a50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7340097a0 tx=0x7fe73402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291fb5ef1d449191 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe7427fc640 1 -- 172.21.15.84:0/2963156013 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7340315a0 con 0x7fe7440c7f50 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe7427fc640 1 -- 172.21.15.84:0/2963156013 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe734037070 con 0x7fe7440c7f50 2024-04-14T11:08:15.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe7427fc640 1 -- 172.21.15.84:0/2963156013 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734031940 con 0x7fe7440c7f50 2024-04-14T11:08:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 -- 172.21.15.84:0/2963156013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 msgr2=0x7fe7440c4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 --2- 172.21.15.84:0/2963156013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe7440c4a50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7340097a0 tx=0x7fe73402b840 comp rx=0 tx=0).stop 2024-04-14T11:08:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 -- 172.21.15.84:0/2963156013 shutdown_connections 2024-04-14T11:08:15.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 --2- 172.21.15.84:0/2963156013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe7440c4a50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 --2- 172.21.15.84:0/2963156013 >> v2:172.21.15.175:3300/0 conn(0x7fe744151d90 0x7fe744157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 -- 172.21.15.84:0/2963156013 >> 172.21.15.84:0/2963156013 conn(0x7fe7440cdb80 msgr2=0x7fe744070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 -- 172.21.15.84:0/2963156013 shutdown_connections 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.308+0000 7fe749cb7640 1 -- 172.21.15.84:0/2963156013 wait complete. 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 Processor -- start 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 -- start start 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7440c44e0 0x7fe74414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe74414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 0x7fe744157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe74406cfa0 con 0x7fe744151d90 2024-04-14T11:08:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe744152170 con 0x7fe7440c44e0 2024-04-14T11:08:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.310+0000 7fe749cb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe74406d120 con 0x7fe7440c7f50 2024-04-14T11:08:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe743fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 0x7fe744157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe7437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7440c44e0 0x7fe74414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe74414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe743fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 0x7fe744157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59576/0 (socket says 172.21.15.84:59576) 2024-04-14T11:08:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe7437fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7440c44e0 0x7fe74414b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:55100/0 (socket says 172.21.15.84:55100) 2024-04-14T11:08:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe743fff640 1 -- 172.21.15.84:0/727010320 learned_addr learned my addr 172.21.15.84:0/727010320 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 -- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7440c44e0 msgr2=0x7fe74414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7440c44e0 0x7fe74414b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 -- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 msgr2=0x7fe744157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 0x7fe744157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 -- 172.21.15.84:0/727010320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7441f48c0 con 0x7fe7440c7f50 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe743fff640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 0x7fe744157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe742ffd640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe74414df50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe74415b7e0 tx=0x7fe7340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734032630 con 0x7fe7440c7f50 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7340327d0 con 0x7fe7440c7f50 2024-04-14T11:08:15.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7441f4ba0 con 0x7fe7440c7f50 2024-04-14T11:08:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734032b80 con 0x7fe7440c7f50 2024-04-14T11:08:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.311+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7441f5160 con 0x7fe7440c7f50 2024-04-14T11:08:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.312+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe744069b20 con 0x7fe7440c7f50 2024-04-14T11:08:15.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.313+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe73403b3f0 con 0x7fe7440c7f50 2024-04-14T11:08:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.313+0000 7fe72bfff640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe73006c8f0 0x7fe73006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.313+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fe73402f030 con 0x7fe7440c7f50 2024-04-14T11:08:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.313+0000 7fe7437fe640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe73006c8f0 0x7fe73006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.314+0000 7fe7437fe640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe73006c8f0 0x7fe73006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe738009560 tx=0x7fe738009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.322+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fe734040070 con 0x7fe7440c7f50 2024-04-14T11:08:15.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.371+0000 7f4cdf91e640 1 Processor -- start 2024-04-14T11:08:15.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.371+0000 7f4cdf91e640 1 -- start start 2024-04-14T11:08:15.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.371+0000 7f4cdf91e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4cd815b880 0x7f4cd80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.371+0000 7f4cdf91e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd815f2d0 con 0x7f4cd80cce20 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.371+0000 7f4cdf91e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd815e470 con 0x7f4cd8155130 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.371+0000 7f4cdf91e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd815e750 con 0x7f4cd815b880 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4cdceb9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f4cd80cce20 0x7f4cd815b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53960/0 (socket says 172.21.15.84:53960) 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4cdceb9640 1 -- 172.21.15.84:0/1884336278 learned_addr learned my addr 172.21.15.84:0/1884336278 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4cddebb640 1 --2- 172.21.15.84:0/1884336278 >> v2:172.21.15.175:3300/0 conn(0x7f4cd815b880 0x7f4cd80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4ccffff640 1 -- 172.21.15.84:0/1884336278 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027277236 0 0) 0x7f4cd815f2d0 con 0x7f4cd80cce20 2024-04-14T11:08:15.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4ccffff640 1 -- 172.21.15.84:0/1884336278 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc4003520 con 0x7f4cd80cce20 2024-04-14T11:08:15.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4cddebb640 1 -- 172.21.15.84:0/1884336278 >> v1:172.21.15.175:6789/0 conn(0x7f4cd8155130 legacy=0x7f4cd80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4cddebb640 1 -- 172.21.15.84:0/1884336278 >> v1:172.21.15.84:6789/0 conn(0x7f4cd80cce20 legacy=0x7f4cd815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.372+0000 7f4cddebb640 1 -- 172.21.15.84:0/1884336278 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd815ea30 con 0x7f4cd815b880 2024-04-14T11:08:15.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4cddebb640 1 --2- 172.21.15.84:0/1884336278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd80cc190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009d90 tx=0x7f4cd402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ab084b20aefdbab server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4ccffff640 1 -- 172.21.15.84:0/1884336278 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4039070 con 0x7f4cd815b880 2024-04-14T11:08:15.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4ccffff640 1 -- 172.21.15.84:0/1884336278 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd402cd80 con 0x7f4cd815b880 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4ccffff640 1 -- 172.21.15.84:0/1884336278 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd4034640 con 0x7f4cd815b880 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4cdf91e640 1 -- 172.21.15.84:0/1884336278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 msgr2=0x7f4cd80cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/1884336278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd80cc190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009d90 tx=0x7f4cd402bfd0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4cdf91e640 1 -- 172.21.15.84:0/1884336278 shutdown_connections 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.373+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/1884336278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd80cc190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.374+0000 7f4cdf91e640 1 -- 172.21.15.84:0/1884336278 >> 172.21.15.84:0/1884336278 conn(0x7f4cd80d07b0 msgr2=0x7f4cd80d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.374+0000 7f4cdf91e640 1 -- 172.21.15.84:0/1884336278 shutdown_connections 2024-04-14T11:08:15.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.374+0000 7f4cdf91e640 1 -- 172.21.15.84:0/1884336278 wait complete. 2024-04-14T11:08:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 Processor -- start 2024-04-14T11:08:15.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 -- start start 2024-04-14T11:08:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cd80cce20 0x7f4cd81517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 0x7f4cd815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd814baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd8155510 con 0x7f4cd8155130 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd815eff0 con 0x7f4cd815b880 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdf91e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd80cbb60 con 0x7f4cd80cce20 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdceb9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 0x7f4cd815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdceb9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 0x7f4cd815d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59582/0 (socket says 172.21.15.84:59582) 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.375+0000 7f4cdceb9640 1 -- 172.21.15.84:0/2041761008 learned_addr learned my addr 172.21.15.84:0/2041761008 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cddebb640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd814baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdd6ba640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cd80cce20 0x7f4cd81517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdceb9640 1 -- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cd80cce20 msgr2=0x7f4cd81517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdceb9640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cd80cce20 0x7f4cd81517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdceb9640 1 -- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 msgr2=0x7f4cd814baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdceb9640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd814baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdceb9640 1 -- 172.21.15.84:0/2041761008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd81f4990 con 0x7f4cd8155130 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdceb9640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 0x7f4cd815d9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c500 tx=0x7f4cc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8017070 con 0x7f4cd8155130 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8005ce0 con 0x7f4cd8155130 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd81f4c70 con 0x7f4cd8155130 2024-04-14T11:08:15.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80072f0 con 0x7f4cd8155130 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.376+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd8154880 con 0x7f4cd8155130 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.377+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd80681b0 con 0x7f4cd8155130 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.378+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cc801a070 con 0x7f4cd8155130 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.378+0000 7f4ccdffb640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cbc06c920 0x7f4cbc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.378+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f4cc808aed0 con 0x7f4cd8155130 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.378+0000 7f4cdd6ba640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cbc06c920 0x7f4cbc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.379+0000 7f4cdd6ba640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cbc06c920 0x7f4cbc06ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0001780 tx=0x7f4cd0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.383+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f4cd80681b0 con 0x7f4cd8155130 2024-04-14T11:08:15.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.501+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe744156fe0 con 0x7fe7440c7f50 2024-04-14T11:08:15.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.502+0000 7fe72bfff640 1 -- 172.21.15.84:0/727010320 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7fe73407b5f0 con 0x7fe7440c7f50 2024-04-14T11:08:15.492 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe73006c8f0 msgr2=0x7fe73006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe73006c8f0 0x7fe73006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe738009560 tx=0x7fe738009190 comp rx=0 tx=0).stop 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 msgr2=0x7fe74414df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe74414df50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe74415b7e0 tx=0x7fe7340046c0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 shutdown_connections 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fe73006c8f0 0x7fe73006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe744151d90 0x7fe744157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7440c7f50 0x7fe74414df50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 --2- 172.21.15.84:0/727010320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7440c44e0 0x7fe74414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 >> 172.21.15.84:0/727010320 conn(0x7fe7440cdb80 msgr2=0x7fe7440c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 shutdown_connections 2024-04-14T11:08:15.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.504+0000 7fe749cb7640 1 -- 172.21.15.84:0/727010320 wait complete. 2024-04-14T11:08:15.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T11:08:15.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.562+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cd8069b20 con 0x7f4cd8155130 2024-04-14T11:08:15.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.562+0000 7f4ccdffb640 1 -- 172.21.15.84:0/2041761008 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f4cc8058c50 con 0x7f4cd8155130 2024-04-14T11:08:15.553 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T11:08:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.564+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cbc06c920 msgr2=0x7f4cbc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.564+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cbc06c920 0x7f4cbc06ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0001780 tx=0x7f4cd0009040 comp rx=0 tx=0).stop 2024-04-14T11:08:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.564+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 msgr2=0x7f4cd815d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.564+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 0x7f4cd815d9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c500 tx=0x7f4cc800c9c0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 shutdown_connections 2024-04-14T11:08:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f4cbc06c920 0x7f4cbc06ede0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cd815b880 0x7f4cd814baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4cd8155130 0x7f4cd815d9f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 --2- 172.21.15.84:0/2041761008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cd80cce20 0x7f4cd81517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 >> 172.21.15.84:0/2041761008 conn(0x7f4cd80d07b0 msgr2=0x7f4cd80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 shutdown_connections 2024-04-14T11:08:15.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.565+0000 7f4cdf91e640 1 -- 172.21.15.84:0/2041761008 wait complete. 2024-04-14T11:08:15.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T11:08:15.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 Processor -- start 2024-04-14T11:08:15.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 -- start start 2024-04-14T11:08:15.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d815e8d0 0x7f06d815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f06d80ccf90 0x7f06d80cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d815f230 con 0x7f06d8155270 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f06d815bcd0 con 0x7f06d80ccf90 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06dd71e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06d80cd940 con 0x7f06d815e8d0 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.662+0000 7f06d6ffd640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f06d8155270 0x7f06d80cbc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53974/0 (socket says 172.21.15.84:53974) 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d6ffd640 1 -- 172.21.15.84:0/3243947328 learned_addr learned my addr 172.21.15.84:0/3243947328 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d77fe640 1 --2- 172.21.15.84:0/3243947328 >> v2:172.21.15.175:3300/0 conn(0x7f06d80ccf90 0x7f06d80cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d67fc640 1 --2- 172.21.15.84:0/3243947328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d815e8d0 0x7f06d815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d5ffb640 1 -- 172.21.15.84:0/3243947328 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839476386 0 0) 0x7f06d815f230 con 0x7f06d8155270 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d5ffb640 1 -- 172.21.15.84:0/3243947328 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c4003520 con 0x7f06d8155270 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d67fc640 1 -- 172.21.15.84:0/3243947328 >> v2:172.21.15.175:3300/0 conn(0x7f06d80ccf90 msgr2=0x7f06d80cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d67fc640 1 --2- 172.21.15.84:0/3243947328 >> v2:172.21.15.175:3300/0 conn(0x7f06d80ccf90 0x7f06d80cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d67fc640 1 -- 172.21.15.84:0/3243947328 >> v1:172.21.15.84:6789/0 conn(0x7f06d8155270 legacy=0x7f06d80cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d67fc640 1 -- 172.21.15.84:0/3243947328 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d80cca60 con 0x7f06d815e8d0 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.663+0000 7f06d77fe640 1 --2- 172.21.15.84:0/3243947328 >> v2:172.21.15.175:3300/0 conn(0x7f06d80ccf90 0x7f06d80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.664+0000 7f06d67fc640 1 --2- 172.21.15.84:0/3243947328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d815e8d0 0x7f06d815ecf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097a0 tx=0x7f06c802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d7829b8421a974 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.664+0000 7f06d5ffb640 1 -- 172.21.15.84:0/3243947328 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8034070 con 0x7f06d815e8d0 2024-04-14T11:08:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.664+0000 7f06d5ffb640 1 -- 172.21.15.84:0/3243947328 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c8030800 con 0x7f06d815e8d0 2024-04-14T11:08:15.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.664+0000 7f06d5ffb640 1 -- 172.21.15.84:0/3243947328 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8030bb0 con 0x7f06d815e8d0 2024-04-14T11:08:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 -- 172.21.15.84:0/3243947328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d815e8d0 msgr2=0x7f06d815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 --2- 172.21.15.84:0/3243947328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d815e8d0 0x7f06d815ecf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06c80097a0 tx=0x7f06c802b940 comp rx=0 tx=0).stop 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 -- 172.21.15.84:0/3243947328 shutdown_connections 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 --2- 172.21.15.84:0/3243947328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d815e8d0 0x7f06d815ecf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 --2- 172.21.15.84:0/3243947328 >> v2:172.21.15.175:3300/0 conn(0x7f06d80ccf90 0x7f06d80cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 -- 172.21.15.84:0/3243947328 >> 172.21.15.84:0/3243947328 conn(0x7f06d8067b40 msgr2=0x7f06d806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 -- 172.21.15.84:0/3243947328 shutdown_connections 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.665+0000 7f06dd71e640 1 -- 172.21.15.84:0/3243947328 wait complete. 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.666+0000 7f06dd71e640 1 Processor -- start 2024-04-14T11:08:15.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.666+0000 7f06dd71e640 1 -- start start 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d80ccf90 0x7f06d814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06d8155270 0x7f06d8150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 0x7f06d8151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06d815b710 con 0x7f06d815e8d0 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06d815b430 con 0x7f06d8155270 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06d815b9f0 con 0x7f06d80ccf90 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 0x7f06d8151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 0x7f06d8151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59596/0 (socket says 172.21.15.84:59596) 2024-04-14T11:08:15.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 -- 172.21.15.84:0/1482496378 learned_addr learned my addr 172.21.15.84:0/1482496378 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d6ffd640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d80ccf90 0x7f06d814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d67fc640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06d8155270 0x7f06d8150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 -- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d80ccf90 msgr2=0x7f06d814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d80ccf90 0x7f06d814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 -- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06d8155270 msgr2=0x7f06d8150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06d8155270 0x7f06d8150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 -- 172.21.15.84:0/1482496378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d81f0b30 con 0x7f06d815e8d0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d6ffd640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d80ccf90 0x7f06d814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06d77fe640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 0x7f06d8151420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009f00 tx=0x7f06d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0018030 con 0x7f06d815e8d0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d000ce50 con 0x7f06d815e8d0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0003bb0 con 0x7f06d815e8d0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.667+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d81f0e10 con 0x7f06d815e8d0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.668+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d81f13d0 con 0x7f06d815e8d0 2024-04-14T11:08:15.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.668+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d80cee20 con 0x7f06d815e8d0 2024-04-14T11:08:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.669+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06d001b070 con 0x7f06d815e8d0 2024-04-14T11:08:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.669+0000 7f06cf7fe640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f06b806c8f0 0x7f06b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.669+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f06d008c600 con 0x7f06d815e8d0 2024-04-14T11:08:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.669+0000 7f06d6ffd640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f06b806c8f0 0x7f06b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.670+0000 7f06d6ffd640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f06b806c8f0 0x7f06b806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06c0005880 tx=0x7f06c0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.674+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f06d80cee20 con 0x7f06d815e8d0 2024-04-14T11:08:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 Processor -- start 2024-04-14T11:08:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 -- start start 2024-04-14T11:08:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4201530f0 0x7fa4200c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4200cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4200c94b0 con 0x7fa4200c3590 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fa42015d140 con 0x7fa4201530f0 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa426280640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200c4340 con 0x7fa4200cb000 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.724+0000 7fa41ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4201530f0 0x7fa4200c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41ffff640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fa4201530f0 0x7fa4200c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59598/0 (socket says 172.21.15.84:59598) 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41ffff640 1 -- 172.21.15.84:0/2267031057 learned_addr learned my addr 172.21.15.84:0/2267031057 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41f7fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fa4200c3590 0x7fa42015ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53984/0 (socket says 172.21.15.84:53984) 2024-04-14T11:08:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa42481d640 1 --2- 172.21.15.84:0/2267031057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4200cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41ffff640 1 -- 172.21.15.84:0/2267031057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 msgr2=0x7fa4200cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41ffff640 1 --2- 172.21.15.84:0/2267031057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4200cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41ffff640 1 -- 172.21.15.84:0/2267031057 >> v1:172.21.15.84:6789/0 conn(0x7fa4200c3590 legacy=0x7fa42015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.725+0000 7fa41ffff640 1 -- 172.21.15.84:0/2267031057 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4200c4620 con 0x7fa4201530f0 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa41ffff640 1 --2- 172.21.15.84:0/2267031057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa4200c8f70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa410009870 tx=0x7fa41002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25bc06cc200cec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa41effd640 1 -- 172.21.15.84:0/2267031057 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410034070 con 0x7fa4201530f0 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa41effd640 1 -- 172.21.15.84:0/2267031057 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa410030840 con 0x7fa4201530f0 2024-04-14T11:08:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa41effd640 1 -- 172.21.15.84:0/2267031057 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410030c10 con 0x7fa4201530f0 2024-04-14T11:08:15.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 -- 172.21.15.84:0/2267031057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 msgr2=0x7fa4200c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 --2- 172.21.15.84:0/2267031057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa4200c8f70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa410009870 tx=0x7fa41002b980 comp rx=0 tx=0).stop 2024-04-14T11:08:15.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 -- 172.21.15.84:0/2267031057 shutdown_connections 2024-04-14T11:08:15.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 --2- 172.21.15.84:0/2267031057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4200cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 --2- 172.21.15.84:0/2267031057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa4200c8f70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 -- 172.21.15.84:0/2267031057 >> 172.21.15.84:0/2267031057 conn(0x7fa4200ce570 msgr2=0x7fa4200ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 -- 172.21.15.84:0/2267031057 shutdown_connections 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.726+0000 7fa426280640 1 -- 172.21.15.84:0/2267031057 wait complete. 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.727+0000 7fa426280640 1 Processor -- start 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 -- start start 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4200c3590 0x7fa4200c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4201f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa420151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa42015c510 con 0x7fa4201530f0 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa42015c230 con 0x7fa4200c3590 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa426280640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa42006f6e0 con 0x7fa4200cb000 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa42481d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa420151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa42481d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa420151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59606/0 (socket says 172.21.15.84:59606) 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa42481d640 1 -- 172.21.15.84:0/2112728294 learned_addr learned my addr 172.21.15.84:0/2112728294 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.728+0000 7fa41f7fe640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4201f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41ffff640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4200c3590 0x7fa4200c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41f7fe640 1 -- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4200c3590 msgr2=0x7fa4200c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41f7fe640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4200c3590 0x7fa4200c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41f7fe640 1 -- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 msgr2=0x7fa420151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41f7fe640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa420151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41f7fe640 1 -- 172.21.15.84:0/2112728294 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201f1d00 con 0x7fa4200cb000 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa42481d640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa420151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:15.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41f7fe640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4201f17c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa414000f60 tx=0x7fa41400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4140074e0 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4140047e0 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42006d530 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414004bd0 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.729+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42006b900 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.730+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa420069b20 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.731+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa41401a020 con 0x7fa4200cb000 2024-04-14T11:08:15.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.731+0000 7fa41cff9640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa40c06c8f0 0x7fa40c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.731+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fa41408b150 con 0x7fa4200cb000 2024-04-14T11:08:15.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.731+0000 7fa41ffff640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa40c06c8f0 0x7fa40c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.732+0000 7fa41ffff640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa40c06c8f0 0x7fa40c06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa410036000 tx=0x7fa410008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.739+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fa414058e40 con 0x7fa4200cb000 2024-04-14T11:08:15.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.861+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f06d8069b20 con 0x7f06d815e8d0 2024-04-14T11:08:15.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.861+0000 7f06cf7fe640 1 -- 172.21.15.84:0/1482496378 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7f06d0010040 con 0x7f06d815e8d0 2024-04-14T11:08:15.852 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T11:08:15.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f06b806c8f0 msgr2=0x7f06b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f06b806c8f0 0x7f06b806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06c0005880 tx=0x7f06c0009040 comp rx=0 tx=0).stop 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 msgr2=0x7f06d8151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 0x7f06d8151420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009f00 tx=0x7f06d000c490 comp rx=0 tx=0).stop 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 shutdown_connections 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f06b806c8f0 0x7f06b806edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06d815e8d0 0x7f06d8151420 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06d8155270 0x7f06d8150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 --2- 172.21.15.84:0/1482496378 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06d80ccf90 0x7f06d814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 >> 172.21.15.84:0/1482496378 conn(0x7f06d8067b40 msgr2=0x7f06d80ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 shutdown_connections 2024-04-14T11:08:15.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.863+0000 7f06dd71e640 1 -- 172.21.15.84:0/1482496378 wait complete. 2024-04-14T11:08:15.865 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T11:08:15.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.927+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa4200c9960 con 0x7fa4200cb000 2024-04-14T11:08:15.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.927+0000 7fa41cff9640 1 -- 172.21.15.84:0/2112728294 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7fa41405d140 con 0x7fa4200cb000 2024-04-14T11:08:15.918 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T11:08:15.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa40c06c8f0 msgr2=0x7fa40c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa40c06c8f0 0x7fa40c06edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa410036000 tx=0x7fa410008030 comp rx=0 tx=0).stop 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 msgr2=0x7fa4201f17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4201f17c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa414000f60 tx=0x7fa41400c760 comp rx=0 tx=0).stop 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 shutdown_connections 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fa40c06c8f0 0x7fa40c06edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4201530f0 0x7fa420151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4200cb000 0x7fa4201f17c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 --2- 172.21.15.84:0/2112728294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4200c3590 0x7fa4200c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 >> 172.21.15.84:0/2112728294 conn(0x7fa4200ce570 msgr2=0x7fa4200cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 shutdown_connections 2024-04-14T11:08:15.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.930+0000 7fa426280640 1 -- 172.21.15.84:0/2112728294 wait complete. 2024-04-14T11:08:15.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T11:08:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 Processor -- start 2024-04-14T11:08:15.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 -- start start 2024-04-14T11:08:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e00c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff1e006f8b0 0x7ff1e0159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e00c7fa0 con 0x7ff1e00ce930 2024-04-14T11:08:15.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e00c20b0 con 0x7ff1e006f8b0 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.982+0000 7ff1e6911640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e01591d0 con 0x7ff1e00ce550 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1e4eae640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7ff1e00ce930 0x7ff1e00ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53988/0 (socket says 172.21.15.84:53988) 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1e4eae640 1 -- 172.21.15.84:0/419734327 learned_addr learned my addr 172.21.15.84:0/419734327 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1dffff640 1 --2- 172.21.15.84:0/419734327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e00c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1df7fe640 1 --2- 172.21.15.84:0/419734327 >> v2:172.21.15.175:3300/0 conn(0x7ff1e006f8b0 0x7ff1e0159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1deffd640 1 -- 172.21.15.84:0/419734327 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905080026 0 0) 0x7ff1e00c7fa0 con 0x7ff1e00ce930 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1deffd640 1 -- 172.21.15.84:0/419734327 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c8003520 con 0x7ff1e00ce930 2024-04-14T11:08:15.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1dffff640 1 -- 172.21.15.84:0/419734327 >> v2:172.21.15.175:3300/0 conn(0x7ff1e006f8b0 msgr2=0x7ff1e0159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1dffff640 1 --2- 172.21.15.84:0/419734327 >> v2:172.21.15.175:3300/0 conn(0x7ff1e006f8b0 0x7ff1e0159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1dffff640 1 -- 172.21.15.84:0/419734327 >> v1:172.21.15.84:6789/0 conn(0x7ff1e00ce930 legacy=0x7ff1e00ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1dffff640 1 -- 172.21.15.84:0/419734327 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e00c8280 con 0x7ff1e00ce550 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.983+0000 7ff1df7fe640 1 --2- 172.21.15.84:0/419734327 >> v2:172.21.15.175:3300/0 conn(0x7ff1e006f8b0 0x7ff1e0159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.984+0000 7ff1dffff640 1 --2- 172.21.15.84:0/419734327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e00c7940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00097a0 tx=0x7ff1d002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c629ff9a45f30c45 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.984+0000 7ff1deffd640 1 -- 172.21.15.84:0/419734327 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0034070 con 0x7ff1e00ce550 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.984+0000 7ff1deffd640 1 -- 172.21.15.84:0/419734327 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d0030610 con 0x7ff1e00ce550 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.984+0000 7ff1deffd640 1 -- 172.21.15.84:0/419734327 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00309c0 con 0x7ff1e00ce550 2024-04-14T11:08:15.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 -- 172.21.15.84:0/419734327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 msgr2=0x7ff1e00c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 --2- 172.21.15.84:0/419734327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e00c7940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00097a0 tx=0x7ff1d002b960 comp rx=0 tx=0).stop 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 -- 172.21.15.84:0/419734327 shutdown_connections 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 --2- 172.21.15.84:0/419734327 >> v2:172.21.15.175:3300/0 conn(0x7ff1e006f8b0 0x7ff1e0159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 --2- 172.21.15.84:0/419734327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e00c7940 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 -- 172.21.15.84:0/419734327 >> 172.21.15.84:0/419734327 conn(0x7ff1e006db10 msgr2=0x7ff1e006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 -- 172.21.15.84:0/419734327 shutdown_connections 2024-04-14T11:08:15.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.985+0000 7ff1e6911640 1 -- 172.21.15.84:0/419734327 wait complete. 2024-04-14T11:08:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.986+0000 7ff1e6911640 1 Processor -- start 2024-04-14T11:08:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.986+0000 7ff1e6911640 1 -- start start 2024-04-14T11:08:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e6911640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1e006f8b0 0x7ff1e0153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e6911640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e0157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e6911640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00ce930 0x7ff1e014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e6911640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0159ba0 con 0x7ff1e006f8b0 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e6911640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e0158e60 con 0x7ff1e00ce930 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e6911640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e015c230 con 0x7ff1e00ce550 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1e006f8b0 0x7ff1e0153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e0157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1e006f8b0 0x7ff1e0153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59608/0 (socket says 172.21.15.84:59608) 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1dffff640 1 -- 172.21.15.84:0/1740913291 learned_addr learned my addr 172.21.15.84:0/1740913291 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:15.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1e4eae640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00ce930 0x7ff1e014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 -- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00ce930 msgr2=0x7ff1e014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00ce930 0x7ff1e014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 -- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1e006f8b0 msgr2=0x7ff1e0153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1e006f8b0 0x7ff1e0153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 -- 172.21.15.84:0/1740913291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e00c2290 con 0x7ff1e00ce550 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1df7fe640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e0157ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400e930 tx=0x7ff1d400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.987+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4017070 con 0x7ff1e00ce550 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.988+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d400ca00 con 0x7ff1e00ce550 2024-04-14T11:08:15.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.988+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e00c2550 con 0x7ff1e00ce550 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.988+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400cdd0 con 0x7ff1e00ce550 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.988+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e01576e0 con 0x7ff1e00ce550 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.988+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e0069b20 con 0x7ff1e00ce550 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.989+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff1d401a070 con 0x7ff1e00ce550 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.989+0000 7ff1dcff9640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1cc06c8f0 0x7ff1cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.990+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7ff1d408ba20 con 0x7ff1e00ce550 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.990+0000 7ff1dffff640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1cc06c8f0 0x7ff1cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:15.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.990+0000 7ff1dffff640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1cc06c8f0 0x7ff1cc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009560 tx=0x7ff1d0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:15.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:15.998+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff1d4059710 con 0x7ff1e00ce550 2024-04-14T11:08:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.050+0000 7f9f6dd1e640 1 Processor -- start 2024-04-14T11:08:16.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.050+0000 7f9f6dd1e640 1 -- start start 2024-04-14T11:08:16.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f6dd1e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f6815b880 0x7f9f680cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f6dd1e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6815f2d0 con 0x7f9f68155130 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f6dd1e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6815e470 con 0x7f9f680cce20 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f6dd1e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9f6815e750 con 0x7f9f6815b880 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f677fe640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f9f68155130 0x7f9f680cb450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:53994/0 (socket says 172.21.15.84:53994) 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f677fe640 1 -- 172.21.15.84:0/2687894493 learned_addr learned my addr 172.21.15.84:0/2687894493 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f67fff640 1 --2- 172.21.15.84:0/2687894493 >> v2:172.21.15.175:3300/0 conn(0x7f9f6815b880 0x7f9f680cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041379545 0 0) 0x7f9f6815f2d0 con 0x7f9f68155130 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f54003520 con 0x7f9f68155130 2024-04-14T11:08:16.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774330265 0 0) 0x7f9f6815e470 con 0x7f9f680cce20 2024-04-14T11:08:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f6815f2d0 con 0x7f9f680cce20 2024-04-14T11:08:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.051+0000 7f9f67fff640 1 -- 172.21.15.84:0/2687894493 >> v1:172.21.15.175:6789/0 conn(0x7f9f680cce20 legacy=0x7f9f6815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.052+0000 7f9f67fff640 1 -- 172.21.15.84:0/2687894493 >> v1:172.21.15.84:6789/0 conn(0x7f9f68155130 legacy=0x7f9f680cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.052+0000 7f9f67fff640 1 -- 172.21.15.84:0/2687894493 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6815ea30 con 0x7f9f6815b880 2024-04-14T11:08:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f67fff640 1 --2- 172.21.15.84:0/2687894493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f680cc190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009d90 tx=0x7f9f6002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb28ff44347cf689 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60039070 con 0x7f9f6815b880 2024-04-14T11:08:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6002cd80 con 0x7f9f6815b880 2024-04-14T11:08:16.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f66ffd640 1 -- 172.21.15.84:0/2687894493 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60034660 con 0x7f9f6815b880 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2687894493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 msgr2=0x7f9f680cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2687894493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f680cc190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009d90 tx=0x7f9f6002bfd0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2687894493 shutdown_connections 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2687894493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f680cc190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.053+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2687894493 >> 172.21.15.84:0/2687894493 conn(0x7f9f680d07b0 msgr2=0x7f9f680d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.054+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2687894493 shutdown_connections 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.054+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2687894493 wait complete. 2024-04-14T11:08:16.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 Processor -- start 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 -- start start 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 0x7f9f68151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f68155130 0x7f9f68153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f68153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9f68155510 con 0x7f9f680cce20 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6815eff0 con 0x7f9f6815b880 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.055+0000 7f9f6dd1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9f680cbb60 con 0x7f9f68155130 2024-04-14T11:08:16.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 0x7f9f68151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 0x7f9f68151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59618/0 (socket says 172.21.15.84:59618) 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 -- 172.21.15.84:0/2978772851 learned_addr learned my addr 172.21.15.84:0/2978772851 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f67fff640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f68153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f5effd640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f68155130 0x7f9f68153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 -- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f68155130 msgr2=0x7f9f68153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f68155130 0x7f9f68153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 -- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 msgr2=0x7f9f68153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f68153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 -- 172.21.15.84:0/2978772851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f68152fa0 con 0x7f9f680cce20 2024-04-14T11:08:16.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f677fe640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 0x7f9f68151a60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c530 tx=0x7f9f5800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58017070 con 0x7f9f680cce20 2024-04-14T11:08:16.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f58005ce0 con 0x7f9f680cce20 2024-04-14T11:08:16.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58007270 con 0x7f9f680cce20 2024-04-14T11:08:16.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f68150c00 con 0x7f9f680cce20 2024-04-14T11:08:16.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.056+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f681511c0 con 0x7f9f680cce20 2024-04-14T11:08:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.057+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f680cc820 con 0x7f9f680cce20 2024-04-14T11:08:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.058+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f5801a070 con 0x7f9f680cce20 2024-04-14T11:08:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.058+0000 7f9f64ff9640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f4806c920 0x7f9f4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.058+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f9f5808af80 con 0x7f9f680cce20 2024-04-14T11:08:16.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.058+0000 7f9f5effd640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f4806c920 0x7f9f4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.059+0000 7f9f5effd640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f4806c920 0x7f9f4806ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9f50007fd0 tx=0x7f9f50009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.062+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f9f58058be0 con 0x7f9f680cce20 2024-04-14T11:08:16.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.194+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff1e00c1e90 con 0x7ff1e00ce550 2024-04-14T11:08:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.195+0000 7ff1dcff9640 1 -- 172.21.15.84:0/1740913291 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7ff1d405da10 con 0x7ff1e00ce550 2024-04-14T11:08:16.185 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-04-14T11:08:16.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1cc06c8f0 msgr2=0x7ff1cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1cc06c8f0 0x7ff1cc06edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009560 tx=0x7ff1d0008030 comp rx=0 tx=0).stop 2024-04-14T11:08:16.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 msgr2=0x7ff1e0157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e0157ee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400e930 tx=0x7ff1d400edf0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 shutdown_connections 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff1cc06c8f0 0x7ff1cc06edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1e00ce930 0x7ff1e014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1e00ce550 0x7ff1e0157ee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 --2- 172.21.15.84:0/1740913291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff1e006f8b0 0x7ff1e0153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.197+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 >> 172.21.15.84:0/1740913291 conn(0x7ff1e006db10 msgr2=0x7ff1e0071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.198+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 shutdown_connections 2024-04-14T11:08:16.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.198+0000 7ff1e6911640 1 -- 172.21.15.84:0/1740913291 wait complete. 2024-04-14T11:08:16.203 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-14T11:08:16.203 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T11:08:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.253+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f680cbf70 con 0x7f9f680cce20 2024-04-14T11:08:16.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.254+0000 7f9f64ff9640 1 -- 172.21.15.84:0/2978772851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7f9f5805cee0 con 0x7f9f680cce20 2024-04-14T11:08:16.245 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T11:08:16.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f4806c920 msgr2=0x7f9f4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f4806c920 0x7f9f4806ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9f50007fd0 tx=0x7f9f50009040 comp rx=0 tx=0).stop 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 msgr2=0x7f9f68151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 0x7f9f68151a60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800c530 tx=0x7f9f5800c9f0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 shutdown_connections 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f9f4806c920 0x7f9f4806ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f6815b880 0x7f9f68153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f68155130 0x7f9f68153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 --2- 172.21.15.84:0/2978772851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f680cce20 0x7f9f68151a60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 >> 172.21.15.84:0/2978772851 conn(0x7f9f680d07b0 msgr2=0x7f9f680c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 shutdown_connections 2024-04-14T11:08:16.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.256+0000 7f9f6dd1e640 1 -- 172.21.15.84:0/2978772851 wait complete. 2024-04-14T11:08:16.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T11:08:16.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T11:08:16.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.412+0000 7ff986ec8640 1 Processor -- start 2024-04-14T11:08:16.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.412+0000 7ff986ec8640 1 -- start start 2024-04-14T11:08:16.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7f5f5f715640 1 Processor -- start 2024-04-14T11:08:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff986ec8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff980155160 0x7ff9800cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff986ec8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98015b6d0 0x7ff9800cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff986ec8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9800ccd90 con 0x7ff9800b3930 2024-04-14T11:08:16.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff986ec8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff98015e4d0 con 0x7ff980155160 2024-04-14T11:08:16.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff986ec8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff98015e7b0 con 0x7ff98015b6d0 2024-04-14T11:08:16.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff985465640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98015b6d0 0x7ff9800cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff984c64640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff980155160 0x7ff9800cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7f5f5f715640 1 -- start start 2024-04-14T11:08:16.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff97ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff9800b3930 0x7ff98015afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:36886/0 (socket says 172.21.15.84:36886) 2024-04-14T11:08:16.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff984c64640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff980155160 0x7ff9800cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:55210/0 (socket says 172.21.15.84:55210) 2024-04-14T11:08:16.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff985465640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98015b6d0 0x7ff9800cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:60194/0 (socket says 172.21.15.84:60194) 2024-04-14T11:08:16.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff97ffff640 1 -- 172.21.15.84:0/2921178852 learned_addr learned my addr 172.21.15.84:0/2921178852 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:16.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff984c64640 1 -- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98015b6d0 msgr2=0x7ff9800cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:16.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff984c64640 1 --2- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98015b6d0 0x7ff9800cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff984c64640 1 -- 172.21.15.84:0/2921178852 >> v1:172.21.15.175:6789/0 conn(0x7ff9800b3930 legacy=0x7ff98015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.413+0000 7ff984c64640 1 -- 172.21.15.84:0/2921178852 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98015ea90 con 0x7ff980155160 2024-04-14T11:08:16.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5f715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f58151d20 0x7f5f581579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5f715640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f580c4a10 con 0x7f5f580c7100 2024-04-14T11:08:16.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5f715640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f580c4c80 con 0x7f5f580c43e0 2024-04-14T11:08:16.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5f715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f580c4f60 con 0x7f5f58151d20 2024-04-14T11:08:16.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5d4b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f58151d20 0x7f5f581579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5dcb2640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f5f580c7100 0x7f5f58162320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54002/0 (socket says 172.21.15.84:54002) 2024-04-14T11:08:16.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5dcb2640 1 -- 172.21.15.84:0/229058358 learned_addr learned my addr 172.21.15.84:0/229058358 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:16.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7ff984c64640 1 --2- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff980155160 0x7ff9800cb3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff978009d90 tx=0x7ff97802bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b557661f24882929 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/229058358 >> v1:172.21.15.175:6789/0 conn(0x7f5f580c43e0 legacy=0x7f5f5806fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f4ffff640 1 -- 172.21.15.84:0/229058358 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530228063 0 0) 0x7f5f580c4a10 con 0x7f5f580c7100 2024-04-14T11:08:16.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/229058358 >> v1:172.21.15.84:6789/0 conn(0x7f5f580c7100 legacy=0x7f5f58162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/229058358 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5815b1a0 con 0x7f5f58151d20 2024-04-14T11:08:16.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.414+0000 7ff97f7fe640 1 -- 172.21.15.84:0/2921178852 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978039070 con 0x7ff980155160 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff97f7fe640 1 -- 172.21.15.84:0/2921178852 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97802cce0 con 0x7ff980155160 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff97f7fe640 1 -- 172.21.15.84:0/2921178852 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978034660 con 0x7ff980155160 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 -- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff980155160 msgr2=0x7ff9800cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 --2- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff980155160 0x7ff9800cb3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff978009d90 tx=0x7ff97802bf30 comp rx=0 tx=0).stop 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 -- 172.21.15.84:0/2921178852 shutdown_connections 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 --2- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98015b6d0 0x7ff9800cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 --2- 172.21.15.84:0/2921178852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff980155160 0x7ff9800cb3d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7f5f5d4b1640 1 --2- 172.21.15.84:0/229058358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f58151d20 0x7f5f581579e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009dc0 tx=0x7f5f5002be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b31ddaf40dcfbe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 -- 172.21.15.84:0/2921178852 >> 172.21.15.84:0/2921178852 conn(0x7ff98006b900 msgr2=0x7ff98006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 -- 172.21.15.84:0/2921178852 shutdown_connections 2024-04-14T11:08:16.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7ff986ec8640 1 -- 172.21.15.84:0/2921178852 wait complete. 2024-04-14T11:08:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7f5f4ffff640 1 -- 172.21.15.84:0/229058358 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50039070 con 0x7f5f58151d20 2024-04-14T11:08:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7f5f4ffff640 1 -- 172.21.15.84:0/229058358 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5002cb30 con 0x7f5f58151d20 2024-04-14T11:08:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.415+0000 7f5f4ffff640 1 -- 172.21.15.84:0/229058358 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50034440 con 0x7f5f58151d20 2024-04-14T11:08:16.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 -- 172.21.15.84:0/229058358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f58151d20 msgr2=0x7f5f581579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 --2- 172.21.15.84:0/229058358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f58151d20 0x7f5f581579e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009dc0 tx=0x7f5f5002be00 comp rx=0 tx=0).stop 2024-04-14T11:08:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 -- 172.21.15.84:0/229058358 shutdown_connections 2024-04-14T11:08:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 --2- 172.21.15.84:0/229058358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f58151d20 0x7f5f581579e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 -- 172.21.15.84:0/229058358 >> 172.21.15.84:0/229058358 conn(0x7f5f580c9f70 msgr2=0x7f5f580ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 -- 172.21.15.84:0/229058358 shutdown_connections 2024-04-14T11:08:16.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7f5f5f715640 1 -- 172.21.15.84:0/229058358 wait complete. 2024-04-14T11:08:16.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7ff986ec8640 1 Processor -- start 2024-04-14T11:08:16.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.416+0000 7ff986ec8640 1 -- start start 2024-04-14T11:08:16.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff986ec8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 0x7ff9801512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7f5f5f715640 1 Processor -- start 2024-04-14T11:08:16.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff986ec8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff980155160 0x7ff9801f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff986ec8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98015b6d0 0x7ff9801f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff986ec8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff980155540 con 0x7ff9800b3930 2024-04-14T11:08:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff986ec8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff98015f050 con 0x7ff98015b6d0 2024-04-14T11:08:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff986ec8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9800cc150 con 0x7ff980155160 2024-04-14T11:08:16.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7f5f5f715640 1 -- start start 2024-04-14T11:08:16.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff984c64640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 0x7ff9801512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff984c64640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 0x7ff9801512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59630/0 (socket says 172.21.15.84:59630) 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff984c64640 1 -- 172.21.15.84:0/688692538 learned_addr learned my addr 172.21.15.84:0/688692538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff985465640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98015b6d0 0x7ff9801f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.417+0000 7ff97ffff640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff980155160 0x7ff9801f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff984c64640 1 -- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff980155160 msgr2=0x7ff9801f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff984c64640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff980155160 0x7ff9801f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff984c64640 1 -- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98015b6d0 msgr2=0x7ff9801f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff984c64640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98015b6d0 0x7ff9801f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff984c64640 1 -- 172.21.15.84:0/688692538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9800c6d20 con 0x7ff9800b3930 2024-04-14T11:08:16.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff984c64640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 0x7ff9801512e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff978037040 tx=0x7ff978004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978039050 con 0x7ff9800b3930 2024-04-14T11:08:16.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff978045070 con 0x7ff9800b3930 2024-04-14T11:08:16.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9800cfbc0 con 0x7ff9800b3930 2024-04-14T11:08:16.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97803e850 con 0x7ff9800b3930 2024-04-14T11:08:16.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5f715640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 0x7f5f580cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5f715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580c7100 0x7f5f58067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9800ceb20 con 0x7ff9800b3930 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5f715640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f58151d20 0x7f5f58141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5f715640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f580711f0 con 0x7f5f58151d20 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5f715640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f58152100 con 0x7f5f580c43e0 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5f715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f58071370 con 0x7f5f580c7100 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5d4b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 0x7f5f580cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5d4b1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 0x7f5f580cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:55220/0 (socket says 172.21.15.84:55220) 2024-04-14T11:08:16.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/3907519926 learned_addr learned my addr 172.21.15.84:0/3907519926 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.418+0000 7f5f5dcb2640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f58151d20 0x7f5f58141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580c7100 msgr2=0x7f5f58067990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5d4b1640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580c7100 0x7f5f58067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f58151d20 msgr2=0x7f5f58141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5d4b1640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f58151d20 0x7f5f58141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5d4b1640 1 -- 172.21.15.84:0/3907519926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f580cc290 con 0x7f5f580c43e0 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5d4b1640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 0x7f5f580cbd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009ee0 tx=0x7f5f50004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50044020 con 0x7f5f580c43e0 2024-04-14T11:08:16.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5003f670 con 0x7f5f580c43e0 2024-04-14T11:08:16.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5815abd0 con 0x7f5f580c43e0 2024-04-14T11:08:16.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50039040 con 0x7f5f580c43e0 2024-04-14T11:08:16.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.419+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f58159090 con 0x7f5f580c43e0 2024-04-14T11:08:16.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.420+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff97803e9f0 con 0x7ff9800b3930 2024-04-14T11:08:16.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.420+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff980069c30 con 0x7ff9800b3930 2024-04-14T11:08:16.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.420+0000 7ff97d7fa640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff96c06c8f0 0x7ff96c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.420+0000 7ff97ffff640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff96c06c8f0 0x7ff96c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.420+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7ff9780ae9f0 con 0x7ff9800b3930 2024-04-14T11:08:16.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.420+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f58070f60 con 0x7f5f580c43e0 2024-04-14T11:08:16.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.421+0000 7ff97ffff640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff96c06c8f0 0x7ff96c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9800b62a0 tx=0x7ff974007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.421+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f50047020 con 0x7f5f580c43e0 2024-04-14T11:08:16.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.421+0000 7f5f4dffb640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5f3c06c8f0 0x7f5f3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.421+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f5f500ae8d0 con 0x7f5f580c43e0 2024-04-14T11:08:16.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.421+0000 7f5f5ccb0640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5f3c06c8f0 0x7f5f3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.422+0000 7f5f5ccb0640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5f3c06c8f0 0x7f5f3c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f58070880 tx=0x7f5f48007930 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.425+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7ff97807c890 con 0x7ff9800b3930 2024-04-14T11:08:16.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.426+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f5f5004e030 con 0x7f5f580c43e0 2024-04-14T11:08:16.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.610+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff980151a90 con 0x7ff9800b3930 2024-04-14T11:08:16.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.611+0000 7ff97d7fa640 1 -- 172.21.15.84:0/688692538 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17039 (secure 0 0 0) 0x7ff978080b90 con 0x7ff9800b3930 2024-04-14T11:08:16.601 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:16.602 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":37,"fsid":"8f4fd445-3fea-4722-8345-0096c2ce143b","created":"2024-04-14T10:57:39.228760+0000","modified":"2024-04-14T11:01:54.049114+0000","last_up_change":"2024-04-14T10:57:50.430789+0000","last_in_change":"2024-04-14T10:57:41.474103+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:57:51.417854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:58:01.440142+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:58:02.487756+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e6df873-1067-4c9b-8da2-bfa07bdc180a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6806","nonce":4267696951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6810","nonce":4267696951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6815","nonce":4267696951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":4267696951},{"type":"v1","addr":"172.21.15.84:6813","nonce":4267696951}]},"public_addr":"172.21.15.84:6806/4267696951","cluster_addr":"172.21.15.84:6810/4267696951","heartbeat_back_addr":"172.21.15.84:6815/4267696951","heartbeat_front_addr":"172.21.15.84:6813/4267696951","state":["exists","up"]},{"osd":1,"uuid":"6b17ad9e-a491-45e4-8731-7922ba981947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6817","nonce":2733326547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6819","nonce":2733326547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6823","nonce":2733326547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":2733326547},{"type":"v1","addr":"172.21.15.84:6821","nonce":2733326547}]},"public_addr":"172.21.15.84:6817/2733326547","cluster_addr":"172.21.15.84:6819/2733326547","heartbeat_back_addr":"172.21.15.84:6823/2733326547","heartbeat_front_addr":"172.21.15.84:6821/2733326547","state":["exists","up"]},{"osd":2,"uuid":"4f3b473c-f0b1-450d-83a3-8789467829e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6825","nonce":3317034191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6827","nonce":3317034191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6831","nonce":3317034191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3317034191},{"type":"v1","addr":"172.21.15.84:6829","nonce":3317034191}]},"public_addr":"172.21.15.84:6825/3317034191","cluster_addr":"172.21.15.84:6827/3317034191","heartbeat_back_addr":"172.21.15.84:6831/3317034191","heartbeat_front_addr":"172.21.15.84:6829/3317034191","state":["exists","up"]},{"osd":3,"uuid":"406a1d3c-5134-45a7-8b6f-b7b8f3631f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6801","nonce":895171386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6803","nonce":895171386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6811","nonce":895171386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":895171386},{"type":"v1","addr":"172.21.15.84:6807","nonce":895171386}]},"public_addr":"172.21.15.84:6801/895171386","cluster_addr":"172.21.15.84:6803/895171386","heartbeat_back_addr":"172.21.15.84:6811/895171386","heartbeat_front_addr":"172.21.15.84:6807/895171386","state":["exists","up"]},{"osd":4,"uuid":"a3faf3f9-c5f5-4603-8fbd-0d19abc7e5a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6817","nonce":324857761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6819","nonce":324857761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6823","nonce":324857761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":324857761},{"type":"v1","addr":"172.21.15.175:6821","nonce":324857761}]},"public_addr":"172.21.15.175:6817/324857761","cluster_addr":"172.21.15.175:6819/324857761","heartbeat_back_addr":"172.21.15.175:6823/324857761","heartbeat_front_addr":"172.21.15.175:6821/324857761","state":["exists","up"]},{"osd":5,"uuid":"013406d6-5429-4687-9089-7fb92a8b293d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6825","nonce":1825582812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6827","nonce":1825582812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6831","nonce":1825582812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1825582812},{"type":"v1","addr":"172.21.15.175:6829","nonce":1825582812}]},"public_addr":"172.21.15.175:6825/1825582812","cluster_addr":"172.21.15.175:6827/1825582812","heartbeat_back_addr":"172.21.15.175:6831/1825582812","heartbeat_front_addr":"172.21.15.175:6829/1825582812","state":["exists","up"]},{"osd":6,"uuid":"03dfbecf-9dbd-4da6-953c-72a37db7ec88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6801","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6803","nonce":1284380825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6807","nonce":1284380825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6813","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6815","nonce":1284380825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1284380825},{"type":"v1","addr":"172.21.15.175:6811","nonce":1284380825}]},"public_addr":"172.21.15.175:6803/1284380825","cluster_addr":"172.21.15.175:6807/1284380825","heartbeat_back_addr":"172.21.15.175:6815/1284380825","heartbeat_front_addr":"172.21.15.175:6811/1284380825","state":["exists","up"]},{"osd":7,"uuid":"9aff0954-143c-4d74-97e3-5257ae629cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6802","nonce":640638539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6806","nonce":640638539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6814","nonce":640638539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":640638539},{"type":"v1","addr":"172.21.15.175:6810","nonce":640638539}]},"public_addr":"172.21.15.175:6802/640638539","cluster_addr":"172.21.15.175:6806/640638539","heartbeat_back_addr":"172.21.15.175:6814/640638539","heartbeat_front_addr":"172.21.15.175:6810/640638539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.609817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.635241+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.664808+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.538478+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.622436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.685348+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.638355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:57:46.636440+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"3.2c","mappings":[{"from":4,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":504,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T11:08:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff96c06c8f0 msgr2=0x7ff96c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff96c06c8f0 0x7ff96c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff9800b62a0 tx=0x7ff974007e80 comp rx=0 tx=0).stop 2024-04-14T11:08:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 msgr2=0x7ff9801512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 0x7ff9801512e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff978037040 tx=0x7ff978004a40 comp rx=0 tx=0).stop 2024-04-14T11:08:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 shutdown_connections 2024-04-14T11:08:16.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7ff96c06c8f0 0x7ff96c06edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98015b6d0 0x7ff9801f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff980155160 0x7ff9801f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 --2- 172.21.15.84:0/688692538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff9800b3930 0x7ff9801512e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 >> 172.21.15.84:0/688692538 conn(0x7ff98006b900 msgr2=0x7ff980152a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 shutdown_connections 2024-04-14T11:08:16.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.614+0000 7ff986ec8640 1 -- 172.21.15.84:0/688692538 wait complete. 2024-04-14T11:08:16.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:57:51.417854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:58:01.440142+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:58:02.487756+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 35, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T11:08:16.620 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T11:08:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.632+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5f580705d0 con 0x7f5f580c43e0 2024-04-14T11:08:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.633+0000 7f5f4dffb640 1 -- 172.21.15.84:0/3907519926 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f5f5007cae0 con 0x7f5f580c43e0 2024-04-14T11:08:16.623 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5f3c06c8f0 msgr2=0x7f5f3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5f3c06c8f0 0x7f5f3c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f58070880 tx=0x7f5f48007930 comp rx=0 tx=0).stop 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 msgr2=0x7f5f580cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 0x7f5f580cbd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009ee0 tx=0x7f5f50004a40 comp rx=0 tx=0).stop 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 shutdown_connections 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f5f3c06c8f0 0x7f5f3c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f58151d20 0x7f5f58141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580c7100 0x7f5f58067990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 --2- 172.21.15.84:0/3907519926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f580c43e0 0x7f5f580cbd50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 >> 172.21.15.84:0/3907519926 conn(0x7f5f580c9f70 msgr2=0x7f5f58150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 shutdown_connections 2024-04-14T11:08:16.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.635+0000 7f5f5f715640 1 -- 172.21.15.84:0/3907519926 wait complete. 2024-04-14T11:08:16.637 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi084.front.sepia.ceph.com... 2024-04-14T11:08:16.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T11:08:16.638 DEBUG:teuthology.orchestra.run.smithi084:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-14T11:08:16.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.736+0000 7fbffff5e640 1 Processor -- start 2024-04-14T11:08:16.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.736+0000 7fbffff5e640 1 -- start start 2024-04-14T11:08:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffff5e640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbff815b880 0x7fbff80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffff5e640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff815f2d0 con 0x7fbff80cce20 2024-04-14T11:08:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffff5e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff815e470 con 0x7fbff8155130 2024-04-14T11:08:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffff5e640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fbff815e750 con 0x7fbff815b880 2024-04-14T11:08:16.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffe4fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbff815b880 0x7fbff80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffd4f9640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7fbff80cce20 0x7fbff815b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54004/0 (socket says 172.21.15.84:54004) 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffd4f9640 1 -- 172.21.15.84:0/314368438 learned_addr learned my addr 172.21.15.84:0/314368438 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.737+0000 7fbffe4fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fbff815b880 0x7fbff80cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59652/0 (socket says 172.21.15.84:59652) 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.738+0000 7fbffe4fb640 1 -- 172.21.15.84:0/314368438 >> v1:172.21.15.175:6789/0 conn(0x7fbff8155130 legacy=0x7fbff80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.738+0000 7fbffe4fb640 1 -- 172.21.15.84:0/314368438 >> v1:172.21.15.84:6789/0 conn(0x7fbff80cce20 legacy=0x7fbff815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.738+0000 7fbffccf8640 1 -- 172.21.15.84:0/314368438 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108309368 0 0) 0x7fbff815f2d0 con 0x7fbff80cce20 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.738+0000 7fbffe4fb640 1 -- 172.21.15.84:0/314368438 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff815ea30 con 0x7fbff815b880 2024-04-14T11:08:16.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.738+0000 7fbffe4fb640 1 --2- 172.21.15.84:0/314368438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff815b880 0x7fbff80cc190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbff40097a0 tx=0x7fbff402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db2ccb5f471a4e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffccf8640 1 -- 172.21.15.84:0/314368438 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff402f810 con 0x7fbff815b880 2024-04-14T11:08:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffccf8640 1 -- 172.21.15.84:0/314368438 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff402f9b0 con 0x7fbff815b880 2024-04-14T11:08:16.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffccf8640 1 -- 172.21.15.84:0/314368438 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff402fd80 con 0x7fbff815b880 2024-04-14T11:08:16.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 -- 172.21.15.84:0/314368438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff815b880 msgr2=0x7fbff80cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 --2- 172.21.15.84:0/314368438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff815b880 0x7fbff80cc190 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbff40097a0 tx=0x7fbff402b9f0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 -- 172.21.15.84:0/314368438 shutdown_connections 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 --2- 172.21.15.84:0/314368438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff815b880 0x7fbff80cc190 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 -- 172.21.15.84:0/314368438 >> 172.21.15.84:0/314368438 conn(0x7fbff80d07b0 msgr2=0x7fbff80d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 -- 172.21.15.84:0/314368438 shutdown_connections 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.739+0000 7fbffff5e640 1 -- 172.21.15.84:0/314368438 wait complete. 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.740+0000 7fbffff5e640 1 Processor -- start 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.740+0000 7fbffff5e640 1 -- start start 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffff5e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbff80cce20 0x7fbff80c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffff5e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 0x7fbff8151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffff5e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff815b880 0x7fbff8151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffff5e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbff8155510 con 0x7fbff8155130 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffff5e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbff815eff0 con 0x7fbff815b880 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffff5e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbff80cbb60 con 0x7fbff80cce20 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffd4f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 0x7fbff8151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffd4f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 0x7fbff8151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59662/0 (socket says 172.21.15.84:59662) 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffd4f9640 1 -- 172.21.15.84:0/750131925 learned_addr learned my addr 172.21.15.84:0/750131925 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffdcfa640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbff80cce20 0x7fbff80c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.741+0000 7fbffe4fb640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff815b880 0x7fbff8151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffd4f9640 1 -- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbff80cce20 msgr2=0x7fbff80c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffd4f9640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbff80cce20 0x7fbff80c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffd4f9640 1 -- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff815b880 msgr2=0x7fbff8151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffd4f9640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff815b880 0x7fbff8151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffd4f9640 1 -- 172.21.15.84:0/750131925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff815bf40 con 0x7fbff8155130 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffd4f9640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 0x7fbff8151940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800c460 tx=0x7fbfe800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8018070 con 0x7fbff8155130 2024-04-14T11:08:16.737 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8007520 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff815c1e0 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8004a20 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.742+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81f4380 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.743+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff8069b20 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.743+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfe801b070 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.744+0000 7fbfee7fc640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbfdc06c920 0x7fbfdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.744+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fbfe808af10 con 0x7fbff8155130 2024-04-14T11:08:16.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.744+0000 7fbffdcfa640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbfdc06c920 0x7fbfdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:16.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.744+0000 7fbffdcfa640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbfdc06c920 0x7fbfdc06ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbff00012e0 tx=0x7fbff0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:16.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.752+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fbfe8058c00 con 0x7fbff8155130 2024-04-14T11:08:16.752 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:08:16.752 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T11:08:16.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T11:08:16.752 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T11:08:16.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.934+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbff81503e0 con 0x7fbff8155130 2024-04-14T11:08:16.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.935+0000 7fbfee7fc640 1 -- 172.21.15.84:0/750131925 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fbfe805cf00 con 0x7fbff8155130 2024-04-14T11:08:16.925 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbfdc06c920 msgr2=0x7fbfdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbfdc06c920 0x7fbfdc06ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbff00012e0 tx=0x7fbff0009040 comp rx=0 tx=0).stop 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 msgr2=0x7fbff8151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 0x7fbff8151940 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800c460 tx=0x7fbfe800c920 comp rx=0 tx=0).stop 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 shutdown_connections 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fbfdc06c920 0x7fbfdc06ede0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff815b880 0x7fbff8151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbff8155130 0x7fbff8151940 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 --2- 172.21.15.84:0/750131925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbff80cce20 0x7fbff80c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:16.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 >> 172.21.15.84:0/750131925 conn(0x7fbff80d07b0 msgr2=0x7fbff806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:16.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 shutdown_connections 2024-04-14T11:08:16.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:16.937+0000 7fbffff5e640 1 -- 172.21.15.84:0/750131925 wait complete. 2024-04-14T11:08:16.939 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T11:08:17.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.053+0000 7f71eda2d640 1 Processor -- start 2024-04-14T11:08:17.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.053+0000 7f71eda2d640 1 -- start start 2024-04-14T11:08:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71eda2d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f71e80c6de0 0x7f71e815b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71eda2d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e8072ca0 con 0x7f71e80c83e0 2024-04-14T11:08:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71eda2d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e8072f80 con 0x7f71e8067720 2024-04-14T11:08:17.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71eda2d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f71e8151b80 con 0x7f71e80c6de0 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71e67fc640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f71e80c83e0 0x7f71e80c8830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54018/0 (socket says 172.21.15.84:54018) 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71e67fc640 1 -- 172.21.15.84:0/1990329120 learned_addr learned my addr 172.21.15.84:0/1990329120 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71e6ffd640 1 --2- 172.21.15.84:0/1990329120 >> v2:172.21.15.175:3300/0 conn(0x7f71e80c6de0 0x7f71e815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71e5ffb640 1 -- 172.21.15.84:0/1990329120 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444527254 0 0) 0x7f71e8072ca0 con 0x7f71e80c83e0 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.054+0000 7f71e5ffb640 1 -- 172.21.15.84:0/1990329120 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d0003520 con 0x7f71e80c83e0 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.055+0000 7f71e6ffd640 1 -- 172.21.15.84:0/1990329120 >> v1:172.21.15.175:6789/0 conn(0x7f71e8067720 legacy=0x7f71e8067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.055+0000 7f71e6ffd640 1 -- 172.21.15.84:0/1990329120 >> v1:172.21.15.84:6789/0 conn(0x7f71e80c83e0 legacy=0x7f71e80c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.055+0000 7f71e5ffb640 1 -- 172.21.15.84:0/1990329120 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329411694 0 0) 0x7f71e8072f80 con 0x7f71e8067720 2024-04-14T11:08:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.055+0000 7f71e6ffd640 1 -- 172.21.15.84:0/1990329120 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e8073260 con 0x7f71e80c6de0 2024-04-14T11:08:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.055+0000 7f71e6ffd640 1 --2- 172.21.15.84:0/1990329120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c6de0 0x7f71e815b700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71e00097a0 tx=0x7f71e002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dca8297fd5f5136 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71e5ffb640 1 -- 172.21.15.84:0/1990329120 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e002f810 con 0x7f71e80c6de0 2024-04-14T11:08:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71e5ffb640 1 -- 172.21.15.84:0/1990329120 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e002f9b0 con 0x7f71e80c6de0 2024-04-14T11:08:17.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71e5ffb640 1 -- 172.21.15.84:0/1990329120 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e002fd80 con 0x7f71e80c6de0 2024-04-14T11:08:17.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 -- 172.21.15.84:0/1990329120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c6de0 msgr2=0x7f71e815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 --2- 172.21.15.84:0/1990329120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c6de0 0x7f71e815b700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f71e00097a0 tx=0x7f71e002b9f0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 -- 172.21.15.84:0/1990329120 shutdown_connections 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 --2- 172.21.15.84:0/1990329120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c6de0 0x7f71e815b700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 -- 172.21.15.84:0/1990329120 >> 172.21.15.84:0/1990329120 conn(0x7f71e80cd390 msgr2=0x7f71e80cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 -- 172.21.15.84:0/1990329120 shutdown_connections 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.056+0000 7f71eda2d640 1 -- 172.21.15.84:0/1990329120 wait complete. 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.057+0000 7f71eda2d640 1 Processor -- start 2024-04-14T11:08:17.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.057+0000 7f71eda2d640 1 -- start start 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71eda2d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 0x7f71e81e5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71eda2d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71e80c6de0 0x7f71e80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71eda2d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c83e0 0x7f71e814cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71eda2d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8073b90 con 0x7f71e8067720 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71eda2d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71e8073820 con 0x7f71e80c83e0 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71eda2d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f71e80c71c0 con 0x7f71e80c6de0 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 0x7f71e81e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 0x7f71e81e5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59668/0 (socket says 172.21.15.84:59668) 2024-04-14T11:08:17.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71e6ffd640 1 -- 172.21.15.84:0/2887619304 learned_addr learned my addr 172.21.15.84:0/2887619304 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71e77fe640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c83e0 0x7f71e814cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.058+0000 7f71e67fc640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71e80c6de0 0x7f71e80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71e6ffd640 1 -- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71e80c6de0 msgr2=0x7f71e80cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71e6ffd640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71e80c6de0 0x7f71e80cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71e6ffd640 1 -- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c83e0 msgr2=0x7f71e814cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71e6ffd640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c83e0 0x7f71e814cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71e6ffd640 1 -- 172.21.15.84:0/2887619304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e81e5ee0 con 0x7f71e8067720 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71e6ffd640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 0x7f71e81e5630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f71e002c000 tx=0x7f71e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0047070 con 0x7f71e8067720 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e0037810 con 0x7f71e8067720 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e81e61c0 con 0x7f71e8067720 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0037be0 con 0x7f71e8067720 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.059+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e815c1c0 con 0x7f71e8067720 2024-04-14T11:08:17.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.060+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e8069b20 con 0x7f71e8067720 2024-04-14T11:08:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.060+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71e004a070 con 0x7f71e8067720 2024-04-14T11:08:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.061+0000 7f71cffff640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f71d406c8f0 0x7f71d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.061+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f71e00ad880 con 0x7f71e8067720 2024-04-14T11:08:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.061+0000 7f71e67fc640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f71d406c8f0 0x7f71d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.061+0000 7f71e67fc640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f71d406c8f0 0x7f71d406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71e81e55c0 tx=0x7f71dc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.065+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f71e0033030 con 0x7f71e8067720 2024-04-14T11:08:17.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.239+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f71e8151610 con 0x7f71e8067720 2024-04-14T11:08:17.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.239+0000 7f71cffff640 1 -- 172.21.15.84:0/2887619304 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) ==== 104+0+11 (secure 0 0 0) 0x7f71e007b570 con 0x7f71e8067720 2024-04-14T11:08:17.230 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-04-14T11:08:17.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f71d406c8f0 msgr2=0x7f71d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f71d406c8f0 0x7f71d406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71e81e55c0 tx=0x7f71dc009040 comp rx=0 tx=0).stop 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 msgr2=0x7f71e81e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 0x7f71e81e5630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f71e002c000 tx=0x7f71e0004730 comp rx=0 tx=0).stop 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 shutdown_connections 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f71d406c8f0 0x7f71d406edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71e80c83e0 0x7f71e814cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71e80c6de0 0x7f71e80cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 --2- 172.21.15.84:0/2887619304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71e8067720 0x7f71e81e5630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 >> 172.21.15.84:0/2887619304 conn(0x7f71e80cd390 msgr2=0x7f71e81591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 shutdown_connections 2024-04-14T11:08:17.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.241+0000 7f71eda2d640 1 -- 172.21.15.84:0/2887619304 wait complete. 2024-04-14T11:08:17.243 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T11:08:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.356+0000 7f743bade640 1 Processor -- start 2024-04-14T11:08:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.356+0000 7f743bade640 1 -- start start 2024-04-14T11:08:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743bade640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7434157d70 0x7f74340cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743bade640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74340cbe40 0x7f74340cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743bade640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7434158d10 con 0x7f7434151fc0 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743bade640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f743415b800 con 0x7f74340cbe40 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743bade640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f74341581b0 con 0x7f7434157d70 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743a07b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74340cbe40 0x7f74340cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f7439079640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7434157d70 0x7f74340cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743987a640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7434151fc0 0x7f743415bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.84:36916/0 (socket says 172.21.15.84:36916) 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f7439079640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7434157d70 0x7f74340cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:60248/0 (socket says 172.21.15.84:60248) 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743a07b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74340cbe40 0x7f74340cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.84:55254/0 (socket says 172.21.15.84:55254) 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743987a640 1 -- 172.21.15.84:0/1400752747 learned_addr learned my addr 172.21.15.84:0/1400752747 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743a07b640 1 -- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7434157d70 msgr2=0x7f74340cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743a07b640 1 --2- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7434157d70 0x7f74340cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743a07b640 1 -- 172.21.15.84:0/1400752747 >> v1:172.21.15.175:6789/0 conn(0x7f7434151fc0 legacy=0x7f743415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f743a07b640 1 -- 172.21.15.84:0/1400752747 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7434158470 con 0x7f74340cbe40 2024-04-14T11:08:17.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.357+0000 7f7438878640 1 -- 172.21.15.84:0/1400752747 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936726870 0 0) 0x7f7434158d10 con 0x7f7434151fc0 2024-04-14T11:08:17.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.358+0000 7f743a07b640 1 --2- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74340cbe40 0x7f74340cc330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f742c009d90 tx=0x7f742c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3048aa68a4357088 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.358+0000 7f7438878640 1 -- 172.21.15.84:0/1400752747 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c039070 con 0x7f74340cbe40 2024-04-14T11:08:17.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.358+0000 7f7438878640 1 -- 172.21.15.84:0/1400752747 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c02cbc0 con 0x7f74340cbe40 2024-04-14T11:08:17.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.358+0000 7f7438878640 1 -- 172.21.15.84:0/1400752747 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c034440 con 0x7f74340cbe40 2024-04-14T11:08:17.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 -- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74340cbe40 msgr2=0x7f74340cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 --2- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74340cbe40 0x7f74340cc330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f742c009d90 tx=0x7f742c02be10 comp rx=0 tx=0).stop 2024-04-14T11:08:17.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 -- 172.21.15.84:0/1400752747 shutdown_connections 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 --2- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74340cbe40 0x7f74340cc330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 --2- 172.21.15.84:0/1400752747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7434157d70 0x7f74340cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 -- 172.21.15.84:0/1400752747 >> 172.21.15.84:0/1400752747 conn(0x7f74340c8e60 msgr2=0x7f74340c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 -- 172.21.15.84:0/1400752747 shutdown_connections 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.359+0000 7f743bade640 1 -- 172.21.15.84:0/1400752747 wait complete. 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.360+0000 7f743bade640 1 Processor -- start 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.360+0000 7f743bade640 1 -- start start 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74340cbe40 0x7f7434159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7434151fc0 0x7f7434142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 0x7f7434151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f743415b490 con 0x7f7434157d70 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7434158a30 con 0x7f7434151fc0 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f74340ca160 con 0x7f74340cbe40 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 0x7f7434151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743987a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74340cbe40 0x7f7434159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 0x7f7434151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59672/0 (socket says 172.21.15.84:59672) 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743987a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74340cbe40 0x7f7434159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.84:60264/0 (socket says 172.21.15.84:60264) 2024-04-14T11:08:17.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 -- 172.21.15.84:0/1842446235 learned_addr learned my addr 172.21.15.84:0/1842446235 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f7439079640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7434151fc0 0x7f7434142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 -- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74340cbe40 msgr2=0x7f7434159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74340cbe40 0x7f7434159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 -- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7434151fc0 msgr2=0x7f7434142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7434151fc0 0x7f7434142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 -- 172.21.15.84:0/1842446235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74341559b0 con 0x7f7434157d70 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743a07b640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 0x7f7434151070 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f742c009eb0 tx=0x7f742c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c039050 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c045070 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.361+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743415a650 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.362+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c009450 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.362+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7434150590 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.362+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7434069b20 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.363+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f742c03e850 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.363+0000 7f742a7fc640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f741806c920 0x7f741806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.363+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f742c0ae000 con 0x7f7434157d70 2024-04-14T11:08:17.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.363+0000 7f743987a640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f741806c920 0x7f741806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.364+0000 7f743987a640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f741806c920 0x7f741806ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7430007fd0 tx=0x7f7430007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.368+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f742c04e020 con 0x7f7434157d70 2024-04-14T11:08:17.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.544+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f74340c4540 con 0x7f7434157d70 2024-04-14T11:08:17.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.544+0000 7f742a7fc640 1 -- 172.21.15.84:0/1842446235 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) ==== 100+0+11 (secure 0 0 0) 0x7f742c07bd80 con 0x7f7434157d70 2024-04-14T11:08:17.535 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-04-14T11:08:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f741806c920 msgr2=0x7f741806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f741806c920 0x7f741806ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7430007fd0 tx=0x7f7430007de0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 msgr2=0x7f7434151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 0x7f7434151070 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f742c009eb0 tx=0x7f742c004a40 comp rx=0 tx=0).stop 2024-04-14T11:08:17.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 shutdown_connections 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f741806c920 0x7f741806ede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7434157d70 0x7f7434151070 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7434151fc0 0x7f7434142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 --2- 172.21.15.84:0/1842446235 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f74340cbe40 0x7f7434159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 >> 172.21.15.84:0/1842446235 conn(0x7f74340c8e60 msgr2=0x7f74340c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 shutdown_connections 2024-04-14T11:08:17.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.546+0000 7f743bade640 1 -- 172.21.15.84:0/1842446235 wait complete. 2024-04-14T11:08:17.548 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T11:08:17.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.658+0000 7f741882d640 1 Processor -- start 2024-04-14T11:08:17.649 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.658+0000 7f741882d640 1 -- start start 2024-04-14T11:08:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f741882d640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7414152fc0 0x7f74140c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f741882d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f741406b900 0x7f74140c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f741882d640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7414071260 con 0x7f741406fff0 2024-04-14T11:08:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f741882d640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f7414070ca0 con 0x7f7414152fc0 2024-04-14T11:08:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f741882d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7414070f80 con 0x7f741406b900 2024-04-14T11:08:17.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f741259c640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f7414152fc0 0x7f74140c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f7411d9b640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f741406fff0 0x7f741415c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54020/0 (socket says 172.21.15.84:54020) 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f7411d9b640 1 -- 172.21.15.84:0/1963615680 learned_addr learned my addr 172.21.15.84:0/1963615680 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.659+0000 7f7412d9d640 1 --2- 172.21.15.84:0/1963615680 >> v2:172.21.15.175:3300/0 conn(0x7f741406b900 0x7f74140c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.660+0000 7f741259c640 1 -- 172.21.15.84:0/1963615680 >> v2:172.21.15.175:3300/0 conn(0x7f741406b900 msgr2=0x7f74140c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.660+0000 7f741259c640 1 --2- 172.21.15.84:0/1963615680 >> v2:172.21.15.175:3300/0 conn(0x7f741406b900 0x7f74140c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.660+0000 7f741259c640 1 -- 172.21.15.84:0/1963615680 >> v1:172.21.15.84:6789/0 conn(0x7f741406fff0 legacy=0x7f741415c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.660+0000 7f741259c640 1 -- 172.21.15.84:0/1963615680 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74140c7f80 con 0x7f7414152fc0 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.660+0000 7f741259c640 1 --2- 172.21.15.84:0/1963615680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7414152fc0 0x7f74140c6b80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f74140c7810 tx=0x7f740402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33ad1d56867446 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741159a640 1 -- 172.21.15.84:0/1963615680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404039070 con 0x7f7414152fc0 2024-04-14T11:08:17.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741159a640 1 -- 172.21.15.84:0/1963615680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740402cbf0 con 0x7f7414152fc0 2024-04-14T11:08:17.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741159a640 1 -- 172.21.15.84:0/1963615680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404034440 con 0x7f7414152fc0 2024-04-14T11:08:17.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 -- 172.21.15.84:0/1963615680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7414152fc0 msgr2=0x7f74140c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 --2- 172.21.15.84:0/1963615680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7414152fc0 0x7f74140c6b80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f74140c7810 tx=0x7f740402be40 comp rx=0 tx=0).stop 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 -- 172.21.15.84:0/1963615680 shutdown_connections 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 --2- 172.21.15.84:0/1963615680 >> v2:172.21.15.175:3300/0 conn(0x7f741406b900 0x7f74140c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 --2- 172.21.15.84:0/1963615680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7414152fc0 0x7f74140c6b80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 -- 172.21.15.84:0/1963615680 >> 172.21.15.84:0/1963615680 conn(0x7f74140c9f70 msgr2=0x7f74140ca350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 -- 172.21.15.84:0/1963615680 shutdown_connections 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.661+0000 7f741882d640 1 -- 172.21.15.84:0/1963615680 wait complete. 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.662+0000 7f741882d640 1 Processor -- start 2024-04-14T11:08:17.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.662+0000 7f741882d640 1 -- start start 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741882d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 0x7f74141533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741882d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f741406fff0 0x7f74141eed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741882d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7414152fc0 0x7f7414145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741882d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f74140c8540 con 0x7f741406b900 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741882d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f74140739f0 con 0x7f7414152fc0 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741882d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f74140c86c0 con 0x7f741406fff0 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 0x7f74141533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 0x7f74141533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59688/0 (socket says 172.21.15.84:59688) 2024-04-14T11:08:17.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 -- 172.21.15.84:0/2094107415 learned_addr learned my addr 172.21.15.84:0/2094107415 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f7411d9b640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f741406fff0 0x7f74141eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f7412d9d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7414152fc0 0x7f7414145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 -- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f741406fff0 msgr2=0x7f74141eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f741406fff0 0x7f74141eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 -- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7414152fc0 msgr2=0x7f7414145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.663+0000 7f741259c640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7414152fc0 0x7f7414145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f741259c640 1 -- 172.21.15.84:0/2094107415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74141ef2a0 con 0x7f741406b900 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f741259c640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 0x7f74141533d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7404009e80 tx=0x7f7404004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404039050 con 0x7f741406b900 2024-04-14T11:08:17.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7404045070 con 0x7f741406b900 2024-04-14T11:08:17.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7414155140 con 0x7f741406b900 2024-04-14T11:08:17.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740403e850 con 0x7f741406b900 2024-04-14T11:08:17.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.664+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7414155700 con 0x7f741406b900 2024-04-14T11:08:17.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.665+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7414070950 con 0x7f741406b900 2024-04-14T11:08:17.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.665+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f740403e9f0 con 0x7f741406b900 2024-04-14T11:08:17.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.666+0000 7f7402ffd640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f73f406c920 0x7f73f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.666+0000 7f7411d9b640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f73f406c920 0x7f73f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.666+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f74040ae760 con 0x7f741406b900 2024-04-14T11:08:17.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.666+0000 7f7411d9b640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f73f406c920 0x7f73f406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7414151760 tx=0x7f7408007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.670+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f740407c600 con 0x7f741406b900 2024-04-14T11:08:17.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.855+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f741414f890 con 0x7f741406b900 2024-04-14T11:08:17.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.856+0000 7f7402ffd640 1 -- 172.21.15.84:0/2094107415 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) ==== 80+0+0 (secure 0 0 0) 0x7f7404080900 con 0x7f741406b900 2024-04-14T11:08:17.846 INFO:teuthology.orchestra.run.smithi084.stderr:listed 0 entries 2024-04-14T11:08:17.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f73f406c920 msgr2=0x7f73f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f73f406c920 0x7f73f406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7414151760 tx=0x7f7408007e80 comp rx=0 tx=0).stop 2024-04-14T11:08:17.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 msgr2=0x7f74141533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 0x7f74141533d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7404009e80 tx=0x7f7404004a40 comp rx=0 tx=0).stop 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 shutdown_connections 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f73f406c920 0x7f73f406ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7414152fc0 0x7f7414145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f741406fff0 0x7f74141eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 --2- 172.21.15.84:0/2094107415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f741406b900 0x7f74141533d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.857+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 >> 172.21.15.84:0/2094107415 conn(0x7f74140c9f70 msgr2=0x7f7414157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.858+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 shutdown_connections 2024-04-14T11:08:17.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.858+0000 7f741882d640 1 -- 172.21.15.84:0/2094107415 wait complete. 2024-04-14T11:08:17.859 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_fuse.py", line 175, in task yield all_mounts File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 294, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 247, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/cephfs/mount.py", line 196, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType 2024-04-14T11:08:17.867 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-14T11:08:17.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T11:08:17.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T11:08:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.990+0000 7f0389c36640 1 Processor -- start 2024-04-14T11:08:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.990+0000 7f0389c36640 1 -- start start 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0389c36640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0384152bf0 0x7f038406f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0389c36640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0384152fd0 0x7f038406f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0389c36640 1 -- --> v1:172.21.15.84:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0384159740 con 0x7f038406fe50 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0389c36640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0384159510 con 0x7f0384152bf0 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0389c36640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f03840c4f50 con 0x7f0384152fd0 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0383fff640 1 --1- >> v1:172.21.15.84:6789/0 conn(0x7f038406fe50 0x7f038415c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.84:6789/0 says I am v1:172.21.15.84:54028/0 (socket says 172.21.15.84:54028) 2024-04-14T11:08:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0383fff640 1 -- 172.21.15.84:0/2504818008 learned_addr learned my addr 172.21.15.84:0/2504818008 (peer_addr_for_me v1:172.21.15.84:0/0) 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03837fe640 1 --2- 172.21.15.84:0/2504818008 >> v2:172.21.15.175:3300/0 conn(0x7f0384152bf0 0x7f038406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f0382ffd640 1 --2- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0384152fd0 0x7f038406f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03827fc640 1 -- 172.21.15.84:0/2504818008 <== mon.0 v1:172.21.15.84:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1734888870 0 0) 0x7f0384159740 con 0x7f038406fe50 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03827fc640 1 -- 172.21.15.84:0/2504818008 --> v1:172.21.15.84:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f036c003520 con 0x7f038406fe50 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03837fe640 1 -- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0384152fd0 msgr2=0x7f038406f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03837fe640 1 --2- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0384152fd0 0x7f038406f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03837fe640 1 -- 172.21.15.84:0/2504818008 >> v1:172.21.15.84:6789/0 conn(0x7f038406fe50 legacy=0x7f038415c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.991+0000 7f03837fe640 1 -- 172.21.15.84:0/2504818008 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384159a00 con 0x7f0384152bf0 2024-04-14T11:08:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.992+0000 7f03837fe640 1 --2- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0384152bf0 0x7f038406f080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03740097a0 tx=0x7f037402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f48fc2004218c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.992+0000 7f03827fc640 1 -- 172.21.15.84:0/2504818008 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374035020 con 0x7f0384152bf0 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.992+0000 7f03827fc640 1 -- 172.21.15.84:0/2504818008 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0374031830 con 0x7f0384152bf0 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.992+0000 7f03827fc640 1 -- 172.21.15.84:0/2504818008 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374031be0 con 0x7f0384152bf0 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 -- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0384152bf0 msgr2=0x7f038406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 --2- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0384152bf0 0x7f038406f080 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f03740097a0 tx=0x7f037402b8d0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 -- 172.21.15.84:0/2504818008 shutdown_connections 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 --2- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0384152fd0 0x7f038406f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 --2- 172.21.15.84:0/2504818008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0384152bf0 0x7f038406f080 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 -- 172.21.15.84:0/2504818008 >> 172.21.15.84:0/2504818008 conn(0x7f03840cc150 msgr2=0x7f03840cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 -- 172.21.15.84:0/2504818008 shutdown_connections 2024-04-14T11:08:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.993+0000 7f0389c36640 1 -- 172.21.15.84:0/2504818008 wait complete. 2024-04-14T11:08:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.994+0000 7f0389c36640 1 Processor -- start 2024-04-14T11:08:17.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.994+0000 7f0389c36640 1 -- start start 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0389c36640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038406fe50 0x7f03841f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0389c36640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 0x7f0384146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0389c36640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038414c710 0x7f0384144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0389c36640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03840c8680 con 0x7f0384152bf0 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0389c36640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03840c8960 con 0x7f038406fe50 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0389c36640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f038406eb60 con 0x7f038414c710 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 0x7f0384146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 0x7f0384146d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59704/0 (socket says 172.21.15.84:59704) 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 -- 172.21.15.84:0/2998503094 learned_addr learned my addr 172.21.15.84:0/2998503094 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0383fff640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038414c710 0x7f0384144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f03837fe640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038406fe50 0x7f03841f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 -- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038414c710 msgr2=0x7f0384144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038414c710 0x7f0384144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 -- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038406fe50 msgr2=0x7f03841f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038406fe50 0x7f03841f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 -- 172.21.15.84:0/2998503094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03841f2b20 con 0x7f0384152bf0 2024-04-14T11:08:17.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.995+0000 7f0382ffd640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 0x7f0384146d70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f037800e930 tx=0x7f037800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.996+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378017070 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.996+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037800c9a0 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.996+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037800cd90 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.996+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0384149e50 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.996+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038414a410 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.997+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0384069c30 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.997+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f037801a070 con 0x7f0384152bf0 2024-04-14T11:08:17.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.998+0000 7f036bfff640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f037006c920 0x7f037006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.998+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f037808be50 con 0x7f0384152bf0 2024-04-14T11:08:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.998+0000 7f03837fe640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f037006c920 0x7f037006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:17.998+0000 7f03837fe640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f037006c920 0x7f037006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0374036000 tx=0x7f0374008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:17.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.002+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f0378059c90 con 0x7f0384152bf0 2024-04-14T11:08:18.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.174+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f038414cef0 con 0x7f037006c920 2024-04-14T11:08:18.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.180+0000 7f036bfff640 1 -- 172.21.15.84:0/2998503094 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+256910 (secure 0 0 0) 0x7f038414cef0 con 0x7f037006c920 2024-04-14T11:08:18.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:18.175 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T11:08:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f037006c920 msgr2=0x7f037006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f037006c920 0x7f037006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0374036000 tx=0x7f0374008030 comp rx=0 tx=0).stop 2024-04-14T11:08:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 msgr2=0x7f0384146d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 0x7f0384146d70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f037800e930 tx=0x7f037800edf0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 shutdown_connections 2024-04-14T11:08:18.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f037006c920 0x7f037006ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f038414c710 0x7f0384144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0384152bf0 0x7f0384146d70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 --2- 172.21.15.84:0/2998503094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f038406fe50 0x7f03841f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.183+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 >> 172.21.15.84:0/2998503094 conn(0x7f03840cc150 msgr2=0x7f03840c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.184+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 shutdown_connections 2024-04-14T11:08:18.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.184+0000 7f0389c36640 1 -- 172.21.15.84:0/2998503094 wait complete. 2024-04-14T11:08:18.186 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-14T11:08:17.523842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1584876347,"num_objects":29094,"num_object_clones":12826,"num_object_copies":58188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29094,"num_whiteouts":12700,"num_read":31623,"num_read_kb":675289,"num_write":74799,"num_write_kb":2597024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88156,"ondisk_log_size":88156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3799024,"kb_used_data":3165168,"kb_used_omap":12,"kb_used_meta":633779,"kb_avail":751175696,"statfs":{"total":773094113280,"available":769203912704,"internally_reserved":0,"allocated":3241132032,"data_stored":3172604936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":648990257},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-71349415,"num_objects":1171,"num_object_clones":472,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":466,"num_read":58,"num_read_kb":75,"num_write":1980,"num_write_kb":84158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002257"},"pg_stats":[{"pgid":"3.3f","version":"37'1097","reported_seq":3322,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.755682+0000","last_change":"2024-04-14T11:01:46.137250+0000","last_active":"2024-04-14T11:08:13.755682+0000","last_peered":"2024-04-14T11:08:13.755682+0000","last_clean":"2024-04-14T11:08:13.755682+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T11:08:13.755682+0000","last_undegraded":"2024-04-14T11:08:13.755682+0000","last_fullsized":"2024-04-14T11:08:13.755682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:47:33.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002702369,"stat_sum":{"num_bytes":11466954,"num_objects":386,"num_object_clones":177,"num_object_copies":772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":177,"num_read":326,"num_read_kb":8995,"num_write":901,"num_write_kb":13037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'1129","reported_seq":3186,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.737886+0000","last_change":"2024-04-14T11:01:46.055486+0000","last_active":"2024-04-14T11:08:12.737886+0000","last_peered":"2024-04-14T11:08:12.737886+0000","last_clean":"2024-04-14T11:08:12.737886+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T11:08:12.737886+0000","last_undegraded":"2024-04-14T11:08:12.737886+0000","last_fullsized":"2024-04-14T11:08:12.737886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:16.820507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018522059999999999,"stat_sum":{"num_bytes":15285159,"num_objects":416,"num_object_clones":193,"num_object_copies":832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":193,"num_read":174,"num_read_kb":4372,"num_write":908,"num_write_kb":16897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"37'1144","reported_seq":3270,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.724898+0000","last_change":"2024-04-14T11:01:46.214621+0000","last_active":"2024-04-14T11:08:13.724898+0000","last_peered":"2024-04-14T11:08:13.724898+0000","last_clean":"2024-04-14T11:08:13.724898+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T11:08:13.724898+0000","last_undegraded":"2024-04-14T11:08:13.724898+0000","last_fullsized":"2024-04-14T11:08:13.724898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1144,"log_dups_size":0,"ondisk_log_size":1144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:29:00.074559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001809642,"stat_sum":{"num_bytes":11725385,"num_objects":431,"num_object_clones":196,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":196,"num_read":246,"num_read_kb":12679,"num_write":923,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"37'1152","reported_seq":3409,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.938512+0000","last_change":"2024-04-14T11:01:46.059362+0000","last_active":"2024-04-14T11:08:12.938512+0000","last_peered":"2024-04-14T11:08:12.938512+0000","last_clean":"2024-04-14T11:08:12.938512+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T11:08:12.938512+0000","last_undegraded":"2024-04-14T11:08:12.938512+0000","last_fullsized":"2024-04-14T11:08:12.938512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:28:57.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033563579999999998,"stat_sum":{"num_bytes":12325249,"num_objects":434,"num_object_clones":202,"num_object_copies":868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":434,"num_whiteouts":202,"num_read":382,"num_read_kb":9143,"num_write":933,"num_write_kb":15459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"37'1225","reported_seq":3678,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.786256+0000","last_change":"2024-04-14T11:01:46.055307+0000","last_active":"2024-04-14T11:08:12.786256+0000","last_peered":"2024-04-14T11:08:12.786256+0000","last_clean":"2024-04-14T11:08:12.786256+0000","last_became_active":"2024-04-14T10:58:44.516419+0000","last_became_peered":"2024-04-14T10:58:44.516419+0000","last_unstale":"2024-04-14T11:08:12.786256+0000","last_undegraded":"2024-04-14T11:08:12.786256+0000","last_fullsized":"2024-04-14T11:08:12.786256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:44:39.578365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016155729999999999,"stat_sum":{"num_bytes":17309501,"num_objects":446,"num_object_clones":205,"num_object_copies":892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":446,"num_whiteouts":205,"num_read":589,"num_read_kb":14854,"num_write":1006,"num_write_kb":18535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'1112","reported_seq":3163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.741545+0000","last_change":"2024-04-14T11:01:46.058846+0000","last_active":"2024-04-14T11:08:13.741545+0000","last_peered":"2024-04-14T11:08:13.741545+0000","last_clean":"2024-04-14T11:08:13.741545+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T11:08:13.741545+0000","last_undegraded":"2024-04-14T11:08:13.741545+0000","last_fullsized":"2024-04-14T11:08:13.741545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1112,"log_dups_size":0,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:47:33.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036241149999999998,"stat_sum":{"num_bytes":12259772,"num_objects":395,"num_object_clones":183,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":183,"num_read":158,"num_read_kb":5715,"num_write":915,"num_write_kb":13761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"37'1182","reported_seq":3735,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.747325+0000","last_change":"2024-04-14T11:01:46.135483+0000","last_active":"2024-04-14T11:08:13.747325+0000","last_peered":"2024-04-14T11:08:13.747325+0000","last_clean":"2024-04-14T11:08:13.747325+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T11:08:13.747325+0000","last_undegraded":"2024-04-14T11:08:13.747325+0000","last_fullsized":"2024-04-14T11:08:13.747325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:18.646219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017791149999999999,"stat_sum":{"num_bytes":20779107,"num_objects":439,"num_object_clones":202,"num_object_copies":878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":202,"num_read":679,"num_read_kb":18773,"num_write":953,"num_write_kb":21796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"37'1113","reported_seq":4044,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.722997+0000","last_change":"2024-04-14T11:01:46.639827+0000","last_active":"2024-04-14T11:08:13.722997+0000","last_peered":"2024-04-14T11:08:13.722997+0000","last_clean":"2024-04-14T11:08:13.722997+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T11:08:13.722997+0000","last_undegraded":"2024-04-14T11:08:13.722997+0000","last_fullsized":"2024-04-14T11:08:13.722997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:30:29.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026442850000000001,"stat_sum":{"num_bytes":37195203,"num_objects":415,"num_object_clones":187,"num_object_copies":830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":415,"num_whiteouts":187,"num_read":1042,"num_read_kb":24039,"num_write":909,"num_write_kb":38397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'1177","reported_seq":3444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.749307+0000","last_change":"2024-04-14T11:01:46.137193+0000","last_active":"2024-04-14T11:08:13.749307+0000","last_peered":"2024-04-14T11:08:13.749307+0000","last_clean":"2024-04-14T11:08:13.749307+0000","last_became_active":"2024-04-14T10:58:44.523574+0000","last_became_peered":"2024-04-14T10:58:44.523574+0000","last_unstale":"2024-04-14T11:08:13.749307+0000","last_undegraded":"2024-04-14T11:08:13.749307+0000","last_fullsized":"2024-04-14T11:08:13.749307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:39.135097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024897719999999999,"stat_sum":{"num_bytes":13063323,"num_objects":437,"num_object_clones":203,"num_object_copies":874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":437,"num_whiteouts":203,"num_read":389,"num_read_kb":13906,"num_write":941,"num_write_kb":19099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"37'1116","reported_seq":3006,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.721269+0000","last_change":"2024-04-14T11:01:46.321779+0000","last_active":"2024-04-14T11:08:12.721269+0000","last_peered":"2024-04-14T11:08:12.721269+0000","last_clean":"2024-04-14T11:08:12.721269+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T11:08:12.721269+0000","last_undegraded":"2024-04-14T11:08:12.721269+0000","last_fullsized":"2024-04-14T11:08:12.721269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:06:16.180543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021398879999999999,"stat_sum":{"num_bytes":2922684,"num_objects":433,"num_object_clones":202,"num_object_copies":866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":433,"num_whiteouts":202,"num_read":16,"num_read_kb":16,"num_write":886,"num_write_kb":9099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"37'1154","reported_seq":3557,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.731371+0000","last_change":"2024-04-14T11:01:46.321654+0000","last_active":"2024-04-14T11:08:13.731371+0000","last_peered":"2024-04-14T11:08:13.731371+0000","last_clean":"2024-04-14T11:08:13.731371+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T11:08:13.731371+0000","last_undegraded":"2024-04-14T11:08:13.731371+0000","last_fullsized":"2024-04-14T11:08:13.731371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:29:12.622348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022578479999999998,"stat_sum":{"num_bytes":12638856,"num_objects":474,"num_object_clones":217,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":474,"num_whiteouts":217,"num_read":544,"num_read_kb":8006,"num_write":928,"num_write_kb":13550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"37'1153","reported_seq":3475,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.133623+0000","last_change":"2024-04-14T11:01:46.056861+0000","last_active":"2024-04-14T11:08:13.133623+0000","last_peered":"2024-04-14T11:08:13.133623+0000","last_clean":"2024-04-14T11:08:13.133623+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T11:08:13.133623+0000","last_undegraded":"2024-04-14T11:08:13.133623+0000","last_fullsized":"2024-04-14T11:08:13.133623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:29:13.953041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012594800000000001,"stat_sum":{"num_bytes":24222591,"num_objects":453,"num_object_clones":206,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":206,"num_read":452,"num_read_kb":8461,"num_write":934,"num_write_kb":30738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"37'1128","reported_seq":3491,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.938605+0000","last_change":"2024-04-14T11:01:46.639627+0000","last_active":"2024-04-14T11:08:12.938605+0000","last_peered":"2024-04-14T11:08:12.938605+0000","last_clean":"2024-04-14T11:08:12.938605+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T11:08:12.938605+0000","last_undegraded":"2024-04-14T11:08:12.938605+0000","last_fullsized":"2024-04-14T11:08:12.938605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1128,"log_dups_size":0,"ondisk_log_size":1128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:18:05.684403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025722029999999999,"stat_sum":{"num_bytes":11961153,"num_objects":440,"num_object_clones":203,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":203,"num_read":490,"num_read_kb":13560,"num_write":896,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"37'1184","reported_seq":3982,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.922968+0000","last_change":"2024-04-14T11:01:46.214395+0000","last_active":"2024-04-14T11:08:12.922968+0000","last_peered":"2024-04-14T11:08:12.922968+0000","last_clean":"2024-04-14T11:08:12.922968+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T11:08:12.922968+0000","last_undegraded":"2024-04-14T11:08:12.922968+0000","last_fullsized":"2024-04-14T11:08:12.922968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1184,"log_dups_size":0,"ondisk_log_size":1184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:34:12.286438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001618658,"stat_sum":{"num_bytes":20313431,"num_objects":451,"num_object_clones":206,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":206,"num_read":928,"num_read_kb":9674,"num_write":949,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'1160","reported_seq":4444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.732122+0000","last_change":"2024-04-14T11:01:46.055304+0000","last_active":"2024-04-14T11:08:12.732122+0000","last_peered":"2024-04-14T11:08:12.732122+0000","last_clean":"2024-04-14T11:08:12.732122+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T11:08:12.732122+0000","last_undegraded":"2024-04-14T11:08:12.732122+0000","last_fullsized":"2024-04-14T11:08:12.732122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:06:16.180543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018964279999999999,"stat_sum":{"num_bytes":25560468,"num_objects":407,"num_object_clones":183,"num_object_copies":814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407,"num_whiteouts":183,"num_read":1391,"num_read_kb":21375,"num_write":955,"num_write_kb":27967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"37'1196","reported_seq":4285,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.734714+0000","last_change":"2024-04-14T11:01:46.058500+0000","last_active":"2024-04-14T11:08:13.734714+0000","last_peered":"2024-04-14T11:08:13.734714+0000","last_clean":"2024-04-14T11:08:13.734714+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T11:08:13.734714+0000","last_undegraded":"2024-04-14T11:08:13.734714+0000","last_fullsized":"2024-04-14T11:08:13.734714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1196,"log_dups_size":0,"ondisk_log_size":1196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:50:54.276293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043860390000000004,"stat_sum":{"num_bytes":36652792,"num_objects":443,"num_object_clones":198,"num_object_copies":886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":443,"num_whiteouts":198,"num_read":1211,"num_read_kb":26111,"num_write":979,"num_write_kb":43955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"37'1225","reported_seq":3111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.758576+0000","last_change":"2024-04-14T11:01:46.059227+0000","last_active":"2024-04-14T11:08:13.758576+0000","last_peered":"2024-04-14T11:08:13.758576+0000","last_clean":"2024-04-14T11:08:13.758576+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T11:08:13.758576+0000","last_undegraded":"2024-04-14T11:08:13.758576+0000","last_fullsized":"2024-04-14T11:08:13.758576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:52:38.581076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033157820000000002,"stat_sum":{"num_bytes":3077638,"num_objects":457,"num_object_clones":212,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":212,"num_read":22,"num_read_kb":4117,"num_write":991,"num_write_kb":13165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"37'1102","reported_seq":3902,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.724786+0000","last_change":"2024-04-14T11:01:46.447958+0000","last_active":"2024-04-14T11:08:12.724786+0000","last_peered":"2024-04-14T11:08:12.724786+0000","last_clean":"2024-04-14T11:08:12.724786+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T11:08:12.724786+0000","last_undegraded":"2024-04-14T11:08:12.724786+0000","last_fullsized":"2024-04-14T11:08:12.724786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:37:00.394998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081958499999999995,"stat_sum":{"num_bytes":20358547,"num_objects":423,"num_object_clones":196,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":423,"num_whiteouts":196,"num_read":920,"num_read_kb":14330,"num_write":886,"num_write_kb":21359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"37'1201","reported_seq":4405,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.823694+0000","last_change":"2024-04-14T11:01:46.136829+0000","last_active":"2024-04-14T11:08:12.823694+0000","last_peered":"2024-04-14T11:08:12.823694+0000","last_clean":"2024-04-14T11:08:12.823694+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T11:08:12.823694+0000","last_undegraded":"2024-04-14T11:08:12.823694+0000","last_fullsized":"2024-04-14T11:08:12.823694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:32.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026237190000000001,"stat_sum":{"num_bytes":29208886,"num_objects":459,"num_object_clones":206,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":206,"num_read":1334,"num_read_kb":31169,"num_write":977,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"37'1181","reported_seq":3114,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.732879+0000","last_change":"2024-04-14T11:01:46.321955+0000","last_active":"2024-04-14T11:08:13.732879+0000","last_peered":"2024-04-14T11:08:13.732879+0000","last_clean":"2024-04-14T11:08:13.732879+0000","last_became_active":"2024-04-14T10:58:44.523695+0000","last_became_peered":"2024-04-14T10:58:44.523695+0000","last_unstale":"2024-04-14T11:08:13.732879+0000","last_undegraded":"2024-04-14T11:08:13.732879+0000","last_fullsized":"2024-04-14T11:08:13.732879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:16.820507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023230210000000002,"stat_sum":{"num_bytes":7847556,"num_objects":445,"num_object_clones":206,"num_object_copies":890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":206,"num_read":58,"num_read_kb":8212,"num_write":943,"num_write_kb":18277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"37'1113","reported_seq":3032,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.761141+0000","last_change":"2024-04-14T11:01:46.215236+0000","last_active":"2024-04-14T11:08:12.761141+0000","last_peered":"2024-04-14T11:08:12.761141+0000","last_clean":"2024-04-14T11:08:12.761141+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T11:08:12.761141+0000","last_undegraded":"2024-04-14T11:08:12.761141+0000","last_fullsized":"2024-04-14T11:08:12.761141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:54:19.283814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002000941,"stat_sum":{"num_bytes":7901151,"num_objects":408,"num_object_clones":180,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":180,"num_read":23,"num_read_kb":23,"num_write":922,"num_write_kb":10575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1240","reported_seq":3188,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.754392+0000","last_change":"2024-04-14T11:01:46.058960+0000","last_active":"2024-04-14T11:08:13.754392+0000","last_peered":"2024-04-14T11:08:13.754392+0000","last_clean":"2024-04-14T11:08:13.754392+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T11:08:13.754392+0000","last_undegraded":"2024-04-14T11:08:13.754392+0000","last_fullsized":"2024-04-14T11:08:13.754392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:58:01.009987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00347453,"stat_sum":{"num_bytes":13082404,"num_objects":473,"num_object_clones":218,"num_object_copies":946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":473,"num_whiteouts":218,"num_read":90,"num_read_kb":4369,"num_write":1003,"num_write_kb":22808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"37'1137","reported_seq":3455,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.780482+0000","last_change":"2024-04-14T11:01:46.639321+0000","last_active":"2024-04-14T11:08:12.780482+0000","last_peered":"2024-04-14T11:08:12.780482+0000","last_clean":"2024-04-14T11:08:12.780482+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T11:08:12.780482+0000","last_undegraded":"2024-04-14T11:08:12.780482+0000","last_fullsized":"2024-04-14T11:08:12.780482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:40:46.860355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002505527,"stat_sum":{"num_bytes":16463473,"num_objects":426,"num_object_clones":196,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":426,"num_whiteouts":196,"num_read":438,"num_read_kb":16566,"num_write":924,"num_write_kb":23014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"37'1182","reported_seq":3253,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.764548+0000","last_change":"2024-04-14T11:01:46.058615+0000","last_active":"2024-04-14T11:08:12.764548+0000","last_peered":"2024-04-14T11:08:12.764548+0000","last_clean":"2024-04-14T11:08:12.764548+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T11:08:12.764548+0000","last_undegraded":"2024-04-14T11:08:12.764548+0000","last_fullsized":"2024-04-14T11:08:12.764548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:32.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044135839999999999,"stat_sum":{"num_bytes":8342677,"num_objects":432,"num_object_clones":203,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":203,"num_read":198,"num_read_kb":3608,"num_write":956,"num_write_kb":11411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"37'1114","reported_seq":4034,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.939033+0000","last_change":"2024-04-14T11:01:46.639583+0000","last_active":"2024-04-14T11:08:11.939033+0000","last_peered":"2024-04-14T11:08:11.939033+0000","last_clean":"2024-04-14T11:08:11.939033+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T11:08:11.939033+0000","last_undegraded":"2024-04-14T11:08:11.939033+0000","last_fullsized":"2024-04-14T11:08:11.939033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:48:12.252007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024445550000000002,"stat_sum":{"num_bytes":24724692,"num_objects":413,"num_object_clones":190,"num_object_copies":826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413,"num_whiteouts":190,"num_read":1034,"num_read_kb":19259,"num_write":891,"num_write_kb":26377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"37'1202","reported_seq":3180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.740992+0000","last_change":"2024-04-14T11:01:46.322213+0000","last_active":"2024-04-14T11:08:13.740992+0000","last_peered":"2024-04-14T11:08:13.740992+0000","last_clean":"2024-04-14T11:08:13.740992+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T11:08:13.740992+0000","last_undegraded":"2024-04-14T11:08:13.740992+0000","last_fullsized":"2024-04-14T11:08:13.740992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1202,"log_dups_size":0,"ondisk_log_size":1202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:44:39.578365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024860920000000001,"stat_sum":{"num_bytes":8801026,"num_objects":422,"num_object_clones":195,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":195,"num_read":97,"num_read_kb":1115,"num_write":982,"num_write_kb":11969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"37'1116","reported_seq":3466,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.738434+0000","last_change":"2024-04-14T11:01:46.055597+0000","last_active":"2024-04-14T11:08:13.738434+0000","last_peered":"2024-04-14T11:08:13.738434+0000","last_clean":"2024-04-14T11:08:13.738434+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T11:08:13.738434+0000","last_undegraded":"2024-04-14T11:08:13.738434+0000","last_fullsized":"2024-04-14T11:08:13.738434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:59:02.701374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018373879999999999,"stat_sum":{"num_bytes":20253028,"num_objects":401,"num_object_clones":181,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":181,"num_read":455,"num_read_kb":7214,"num_write":909,"num_write_kb":22504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"37'1146","reported_seq":3035,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.007958+0000","last_change":"2024-04-14T11:01:46.639339+0000","last_active":"2024-04-14T11:08:13.007958+0000","last_peered":"2024-04-14T11:08:13.007958+0000","last_clean":"2024-04-14T11:08:13.007958+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T11:08:13.007958+0000","last_undegraded":"2024-04-14T11:08:13.007958+0000","last_fullsized":"2024-04-14T11:08:13.007958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:32.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002336702,"stat_sum":{"num_bytes":5336640,"num_objects":435,"num_object_clones":201,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":201,"num_read":14,"num_read_kb":3287,"num_write":933,"num_write_kb":15679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"37'1256","reported_seq":3877,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.111238+0000","last_change":"2024-04-14T11:01:46.215425+0000","last_active":"2024-04-14T11:08:13.111238+0000","last_peered":"2024-04-14T11:08:13.111238+0000","last_clean":"2024-04-14T11:08:13.111238+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T11:08:13.111238+0000","last_undegraded":"2024-04-14T11:08:13.111238+0000","last_fullsized":"2024-04-14T11:08:13.111238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1256,"log_dups_size":0,"ondisk_log_size":1256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:24.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020856070000000002,"stat_sum":{"num_bytes":25309591,"num_objects":484,"num_object_clones":220,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":220,"num_read":765,"num_read_kb":18582,"num_write":1015,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"37'1164","reported_seq":3073,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942805+0000","last_change":"2024-04-14T11:01:46.059118+0000","last_active":"2024-04-14T11:08:15.942805+0000","last_peered":"2024-04-14T11:08:15.942805+0000","last_clean":"2024-04-14T11:08:15.942805+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T11:08:15.942805+0000","last_undegraded":"2024-04-14T11:08:15.942805+0000","last_fullsized":"2024-04-14T11:08:15.942805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:39.135097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033257540000000002,"stat_sum":{"num_bytes":4210817,"num_objects":410,"num_object_clones":188,"num_object_copies":820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":188,"num_read":21,"num_read_kb":21,"num_write":957,"num_write_kb":6804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"37'1274","reported_seq":3636,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.943590+0000","last_change":"2024-04-14T11:01:46.448116+0000","last_active":"2024-04-14T11:08:12.943590+0000","last_peered":"2024-04-14T11:08:12.943590+0000","last_clean":"2024-04-14T11:08:12.943590+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T11:08:12.943590+0000","last_undegraded":"2024-04-14T11:08:12.943590+0000","last_fullsized":"2024-04-14T11:08:12.943590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1274,"log_dups_size":0,"ondisk_log_size":1274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:31.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095383700000000002,"stat_sum":{"num_bytes":25225684,"num_objects":451,"num_object_clones":202,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":202,"num_read":488,"num_read_kb":13946,"num_write":1039,"num_write_kb":32820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"37'1189","reported_seq":4009,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.732840+0000","last_change":"2024-04-14T11:01:46.321289+0000","last_active":"2024-04-14T11:08:13.732840+0000","last_peered":"2024-04-14T11:08:13.732840+0000","last_clean":"2024-04-14T11:08:13.732840+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T11:08:13.732840+0000","last_undegraded":"2024-04-14T11:08:13.732840+0000","last_fullsized":"2024-04-14T11:08:13.732840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:29.137694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020356409999999999,"stat_sum":{"num_bytes":24681299,"num_objects":420,"num_object_clones":191,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":191,"num_read":935,"num_read_kb":14211,"num_write":974,"num_write_kb":26175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"37'1194","reported_seq":4261,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.747966+0000","last_change":"2024-04-14T11:01:46.055881+0000","last_active":"2024-04-14T11:08:12.747966+0000","last_peered":"2024-04-14T11:08:12.747966+0000","last_clean":"2024-04-14T11:08:12.747966+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T11:08:12.747966+0000","last_undegraded":"2024-04-14T11:08:12.747966+0000","last_fullsized":"2024-04-14T11:08:12.747966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:37.096949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001688852,"stat_sum":{"num_bytes":28527487,"num_objects":450,"num_object_clones":201,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":201,"num_read":1192,"num_read_kb":20708,"num_write":976,"num_write_kb":30793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"37'278","reported_seq":330,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942293+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T11:08:15.942293+0000","last_peered":"2024-04-14T11:08:15.942293+0000","last_clean":"2024-04-14T11:08:15.942293+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T11:08:15.942293+0000","last_undegraded":"2024-04-14T11:08:15.942293+0000","last_fullsized":"2024-04-14T11:08:15.942293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46138407,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":316,"num_write_kb":62411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"37'1162","reported_seq":3858,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.735686+0000","last_change":"2024-04-14T11:01:46.215484+0000","last_active":"2024-04-14T11:08:13.735686+0000","last_peered":"2024-04-14T11:08:13.735686+0000","last_clean":"2024-04-14T11:08:13.735686+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T11:08:13.735686+0000","last_undegraded":"2024-04-14T11:08:13.735686+0000","last_fullsized":"2024-04-14T11:08:13.735686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1162,"log_dups_size":0,"ondisk_log_size":1162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:48:05.190616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001900709,"stat_sum":{"num_bytes":17815406,"num_objects":463,"num_object_clones":215,"num_object_copies":926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":463,"num_whiteouts":215,"num_read":835,"num_read_kb":8673,"num_write":923,"num_write_kb":19950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"37'564","reported_seq":616,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.784523+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T11:08:11.784523+0000","last_peered":"2024-04-14T11:08:11.784523+0000","last_clean":"2024-04-14T11:08:11.784523+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T11:08:11.784523+0000","last_undegraded":"2024-04-14T11:08:11.784523+0000","last_fullsized":"2024-04-14T11:08:11.784523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":576,"num_write_kb":62409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"37'365","reported_seq":417,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.815562+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T11:08:15.815562+0000","last_peered":"2024-04-14T11:08:15.815562+0000","last_clean":"2024-04-14T11:08:15.815562+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T11:08:15.815562+0000","last_undegraded":"2024-04-14T11:08:15.815562+0000","last_fullsized":"2024-04-14T11:08:15.815562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":388,"num_write_kb":33534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'1323","reported_seq":4015,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.942807+0000","last_change":"2024-04-14T11:01:46.641098+0000","last_active":"2024-04-14T11:08:11.942807+0000","last_peered":"2024-04-14T11:08:11.942807+0000","last_clean":"2024-04-14T11:08:11.942807+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T11:08:11.942807+0000","last_undegraded":"2024-04-14T11:08:11.942807+0000","last_fullsized":"2024-04-14T11:08:11.942807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:50:54.276293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036777989999999998,"stat_sum":{"num_bytes":29819340,"num_objects":499,"num_object_clones":226,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":226,"num_read":842,"num_read_kb":23290,"num_write":1071,"num_write_kb":43999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"37'609","reported_seq":661,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.689623+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T11:08:11.689623+0000","last_peered":"2024-04-14T11:08:11.689623+0000","last_clean":"2024-04-14T11:08:11.689623+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T11:08:11.689623+0000","last_undegraded":"2024-04-14T11:08:11.689623+0000","last_fullsized":"2024-04-14T11:08:11.689623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":609,"num_write_kb":58510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"37'1129","reported_seq":3711,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.717108+0000","last_change":"2024-04-14T11:01:46.054880+0000","last_active":"2024-04-14T11:08:13.717108+0000","last_peered":"2024-04-14T11:08:13.717108+0000","last_clean":"2024-04-14T11:08:13.717108+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T11:08:13.717108+0000","last_undegraded":"2024-04-14T11:08:13.717108+0000","last_fullsized":"2024-04-14T11:08:13.717108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:29.137694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001465095,"stat_sum":{"num_bytes":24816056,"num_objects":418,"num_object_clones":193,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":193,"num_read":699,"num_read_kb":19897,"num_write":908,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"37'233","reported_seq":285,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374600+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T11:08:14.374600+0000","last_peered":"2024-04-14T11:08:14.374600+0000","last_clean":"2024-04-14T11:08:14.374600+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T11:08:14.374600+0000","last_undegraded":"2024-04-14T11:08:14.374600+0000","last_fullsized":"2024-04-14T11:08:14.374600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":254,"num_write_kb":41665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"37'1146","reported_seq":3057,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.904056+0000","last_change":"2024-04-14T11:01:46.059470+0000","last_active":"2024-04-14T11:08:12.904056+0000","last_peered":"2024-04-14T11:08:12.904056+0000","last_clean":"2024-04-14T11:08:12.904056+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T11:08:12.904056+0000","last_undegraded":"2024-04-14T11:08:12.904056+0000","last_fullsized":"2024-04-14T11:08:12.904056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:37.542711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033562430000000001,"stat_sum":{"num_bytes":8421268,"num_objects":406,"num_object_clones":185,"num_object_copies":812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":406,"num_whiteouts":185,"num_read":20,"num_read_kb":20,"num_write":928,"num_write_kb":10136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"37'663","reported_seq":715,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.783494+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T11:08:11.783494+0000","last_peered":"2024-04-14T11:08:11.783494+0000","last_clean":"2024-04-14T11:08:11.783494+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T11:08:11.783494+0000","last_undegraded":"2024-04-14T11:08:11.783494+0000","last_fullsized":"2024-04-14T11:08:11.783494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":671,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"37'1301","reported_seq":3543,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.719935+0000","last_change":"2024-04-14T11:01:46.214142+0000","last_active":"2024-04-14T11:08:13.719935+0000","last_peered":"2024-04-14T11:08:13.719935+0000","last_clean":"2024-04-14T11:08:13.719935+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T11:08:13.719935+0000","last_undegraded":"2024-04-14T11:08:13.719935+0000","last_fullsized":"2024-04-14T11:08:13.719935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1301,"log_dups_size":0,"ondisk_log_size":1301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:08.021592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001340567,"stat_sum":{"num_bytes":16518466,"num_objects":530,"num_object_clones":280,"num_object_copies":1060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":530,"num_whiteouts":217,"num_read":446,"num_read_kb":12307,"num_write":999,"num_write_kb":17921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"37'885","reported_seq":937,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.567216+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T11:08:13.567216+0000","last_peered":"2024-04-14T11:08:13.567216+0000","last_clean":"2024-04-14T11:08:13.567216+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T11:08:13.567216+0000","last_undegraded":"2024-04-14T11:08:13.567216+0000","last_fullsized":"2024-04-14T11:08:13.567216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":895,"num_write_kb":34181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'1167","reported_seq":3630,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.747601+0000","last_change":"2024-04-14T11:01:46.057047+0000","last_active":"2024-04-14T11:08:13.747601+0000","last_peered":"2024-04-14T11:08:13.747601+0000","last_clean":"2024-04-14T11:08:13.747601+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T11:08:13.747601+0000","last_undegraded":"2024-04-14T11:08:13.747601+0000","last_fullsized":"2024-04-14T11:08:13.747601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:37:50.214998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654339999999999,"stat_sum":{"num_bytes":16000036,"num_objects":435,"num_object_clones":201,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":201,"num_read":588,"num_read_kb":13378,"num_write":954,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"37'646","reported_seq":698,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374304+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T11:08:14.374304+0000","last_peered":"2024-04-14T11:08:14.374304+0000","last_clean":"2024-04-14T11:08:14.374304+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T11:08:14.374304+0000","last_undegraded":"2024-04-14T11:08:14.374304+0000","last_fullsized":"2024-04-14T11:08:14.374304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360800,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":659,"num_write_kb":58272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"37'1153","reported_seq":3642,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.082605+0000","last_change":"2024-04-14T11:01:46.135734+0000","last_active":"2024-04-14T11:08:13.082605+0000","last_peered":"2024-04-14T11:08:13.082605+0000","last_clean":"2024-04-14T11:08:13.082605+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T11:08:13.082605+0000","last_undegraded":"2024-04-14T11:08:13.082605+0000","last_fullsized":"2024-04-14T11:08:13.082605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:30:29.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001966289,"stat_sum":{"num_bytes":16772347,"num_objects":436,"num_object_clones":202,"num_object_copies":872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":202,"num_read":615,"num_read_kb":13306,"num_write":921,"num_write_kb":18622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"37'846","reported_seq":898,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374307+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T11:08:14.374307+0000","last_peered":"2024-04-14T11:08:14.374307+0000","last_clean":"2024-04-14T11:08:14.374307+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T11:08:14.374307+0000","last_undegraded":"2024-04-14T11:08:14.374307+0000","last_fullsized":"2024-04-14T11:08:14.374307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":878,"num_write_kb":33957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"37'1286","reported_seq":3549,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.758806+0000","last_change":"2024-04-14T11:01:46.214983+0000","last_active":"2024-04-14T11:08:12.758806+0000","last_peered":"2024-04-14T11:08:12.758806+0000","last_clean":"2024-04-14T11:08:12.758806+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T11:08:12.758806+0000","last_undegraded":"2024-04-14T11:08:12.758806+0000","last_fullsized":"2024-04-14T11:08:12.758806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:46:01.579743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021176770000000001,"stat_sum":{"num_bytes":12169944,"num_objects":484,"num_object_clones":253,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":190,"num_read":440,"num_read_kb":12791,"num_write":1009,"num_write_kb":30233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"37'169","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.614454+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T11:08:12.614454+0000","last_peered":"2024-04-14T11:08:12.614454+0000","last_clean":"2024-04-14T11:08:12.614454+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T11:08:12.614454+0000","last_undegraded":"2024-04-14T11:08:12.614454+0000","last_fullsized":"2024-04-14T11:08:12.614454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":190,"num_write_kb":17333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"37'1208","reported_seq":3587,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.718354+0000","last_change":"2024-04-14T11:01:46.136556+0000","last_active":"2024-04-14T11:08:13.718354+0000","last_peered":"2024-04-14T11:08:13.718354+0000","last_clean":"2024-04-14T11:08:13.718354+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T11:08:13.718354+0000","last_undegraded":"2024-04-14T11:08:13.718354+0000","last_fullsized":"2024-04-14T11:08:13.718354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:50:54.276293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025159980000000002,"stat_sum":{"num_bytes":11616132,"num_objects":445,"num_object_clones":207,"num_object_copies":890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":207,"num_read":510,"num_read_kb":8723,"num_write":976,"num_write_kb":14293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"37'206","reported_seq":258,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.627554+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T11:08:12.627554+0000","last_peered":"2024-04-14T11:08:12.627554+0000","last_clean":"2024-04-14T11:08:12.627554+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T11:08:12.627554+0000","last_undegraded":"2024-04-14T11:08:12.627554+0000","last_fullsized":"2024-04-14T11:08:12.627554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16778245,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":195,"num_write_kb":25208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"37'1134","reported_seq":3105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.738572+0000","last_change":"2024-04-14T11:01:46.320938+0000","last_active":"2024-04-14T11:08:13.738572+0000","last_peered":"2024-04-14T11:08:13.738572+0000","last_clean":"2024-04-14T11:08:13.738572+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T11:08:13.738572+0000","last_undegraded":"2024-04-14T11:08:13.738572+0000","last_fullsized":"2024-04-14T11:08:13.738572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:53:07.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018262560000000001,"stat_sum":{"num_bytes":12846031,"num_objects":411,"num_object_clones":191,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":411,"num_whiteouts":191,"num_read":87,"num_read_kb":1698,"num_write":907,"num_write_kb":14257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"37'434","reported_seq":486,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.804830+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T11:08:15.804830+0000","last_peered":"2024-04-14T11:08:15.804830+0000","last_clean":"2024-04-14T11:08:15.804830+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T11:08:15.804830+0000","last_undegraded":"2024-04-14T11:08:15.804830+0000","last_fullsized":"2024-04-14T11:08:15.804830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":469,"num_write_kb":25485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"37'1209","reported_seq":3399,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.749310+0000","last_change":"2024-04-14T11:01:46.136117+0000","last_active":"2024-04-14T11:08:13.749310+0000","last_peered":"2024-04-14T11:08:13.749310+0000","last_clean":"2024-04-14T11:08:13.749310+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T11:08:13.749310+0000","last_undegraded":"2024-04-14T11:08:13.749310+0000","last_fullsized":"2024-04-14T11:08:13.749310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:48:12.252007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023378259999999999,"stat_sum":{"num_bytes":12972619,"num_objects":434,"num_object_clones":201,"num_object_copies":868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":434,"num_whiteouts":201,"num_read":315,"num_read_kb":12293,"num_write":980,"num_write_kb":23633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"37'222","reported_seq":274,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.366125+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T11:08:14.366125+0000","last_peered":"2024-04-14T11:08:14.366125+0000","last_clean":"2024-04-14T11:08:14.366125+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T11:08:14.366125+0000","last_undegraded":"2024-04-14T11:08:14.366125+0000","last_fullsized":"2024-04-14T11:08:14.366125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":223,"num_write_kb":33553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"37'1152","reported_seq":3243,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.761527+0000","last_change":"2024-04-14T11:01:46.136842+0000","last_active":"2024-04-14T11:08:13.761527+0000","last_peered":"2024-04-14T11:08:13.761527+0000","last_clean":"2024-04-14T11:08:13.761527+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T11:08:13.761527+0000","last_undegraded":"2024-04-14T11:08:13.761527+0000","last_fullsized":"2024-04-14T11:08:13.761527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:47:30.020829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024830059999999998,"stat_sum":{"num_bytes":12538479,"num_objects":444,"num_object_clones":204,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":204,"num_read":219,"num_read_kb":8478,"num_write":922,"num_write_kb":19471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"37'348","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.967737+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T11:08:11.967737+0000","last_peered":"2024-04-14T11:08:11.967737+0000","last_clean":"2024-04-14T11:08:11.967737+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T11:08:11.967737+0000","last_undegraded":"2024-04-14T11:08:11.967737+0000","last_fullsized":"2024-04-14T11:08:11.967737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":355,"num_write_kb":49989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"37'1146","reported_seq":3378,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.734993+0000","last_change":"2024-04-14T11:01:46.137451+0000","last_active":"2024-04-14T11:08:12.734993+0000","last_peered":"2024-04-14T11:08:12.734993+0000","last_clean":"2024-04-14T11:08:12.734993+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T11:08:12.734993+0000","last_undegraded":"2024-04-14T11:08:12.734993+0000","last_fullsized":"2024-04-14T11:08:12.734993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:58:01.009987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026442639999999999,"stat_sum":{"num_bytes":12130040,"num_objects":419,"num_object_clones":192,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":192,"num_read":348,"num_read_kb":12451,"num_write":933,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"37'318","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.755682+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T11:08:15.755682+0000","last_peered":"2024-04-14T11:08:15.755682+0000","last_clean":"2024-04-14T11:08:15.755682+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T11:08:15.755682+0000","last_undegraded":"2024-04-14T11:08:15.755682+0000","last_fullsized":"2024-04-14T11:08:15.755682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12585503,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":318,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"37'1177","reported_seq":3081,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.736703+0000","last_change":"2024-04-14T11:01:46.059719+0000","last_active":"2024-04-14T11:08:13.736703+0000","last_peered":"2024-04-14T11:08:13.736703+0000","last_clean":"2024-04-14T11:08:13.736703+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T11:08:13.736703+0000","last_undegraded":"2024-04-14T11:08:13.736703+0000","last_fullsized":"2024-04-14T11:08:13.736703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:53:19.962222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032669050000000001,"stat_sum":{"num_bytes":4362818,"num_objects":402,"num_object_clones":186,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":186,"num_read":14,"num_read_kb":14,"num_write":968,"num_write_kb":7521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"37'269","reported_seq":321,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.566674+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T11:08:13.566674+0000","last_peered":"2024-04-14T11:08:13.566674+0000","last_clean":"2024-04-14T11:08:13.566674+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T11:08:13.566674+0000","last_undegraded":"2024-04-14T11:08:13.566674+0000","last_fullsized":"2024-04-14T11:08:13.566674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":279,"num_write_kb":41655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'1140","reported_seq":3935,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.717901+0000","last_change":"2024-04-14T11:01:46.136277+0000","last_active":"2024-04-14T11:08:13.717901+0000","last_peered":"2024-04-14T11:08:13.717901+0000","last_clean":"2024-04-14T11:08:13.717901+0000","last_became_active":"2024-04-14T10:58:44.520085+0000","last_became_peered":"2024-04-14T10:58:44.520085+0000","last_unstale":"2024-04-14T11:08:13.717901+0000","last_undegraded":"2024-04-14T11:08:13.717901+0000","last_fullsized":"2024-04-14T11:08:13.717901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:39:13.715767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022934119999999999,"stat_sum":{"num_bytes":20633743,"num_objects":431,"num_object_clones":196,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":196,"num_read":910,"num_read_kb":15437,"num_write":927,"num_write_kb":27654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":209,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:05:56.463220+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T11:05:56.463220+0000","last_peered":"2024-04-14T11:05:56.463220+0000","last_clean":"2024-04-14T11:05:56.463220+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T11:05:56.463220+0000","last_undegraded":"2024-04-14T11:05:56.463220+0000","last_fullsized":"2024-04-14T11:05:56.463220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"37'218","reported_seq":270,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.782056+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T11:08:11.782056+0000","last_peered":"2024-04-14T11:08:11.782056+0000","last_clean":"2024-04-14T11:08:11.782056+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T11:08:11.782056+0000","last_undegraded":"2024-04-14T11:08:11.782056+0000","last_fullsized":"2024-04-14T11:08:11.782056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":224,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"37'1195","reported_seq":3356,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942349+0000","last_change":"2024-04-14T11:01:46.640781+0000","last_active":"2024-04-14T11:08:15.942349+0000","last_peered":"2024-04-14T11:08:15.942349+0000","last_clean":"2024-04-14T11:08:15.942349+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T11:08:15.942349+0000","last_undegraded":"2024-04-14T11:08:15.942349+0000","last_fullsized":"2024-04-14T11:08:15.942349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1195,"log_dups_size":0,"ondisk_log_size":1195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:18.646219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00346307,"stat_sum":{"num_bytes":8355389,"num_objects":467,"num_object_clones":217,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":217,"num_read":302,"num_read_kb":5669,"num_write":959,"num_write_kb":14511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'243","reported_seq":296,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.785051+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T11:08:11.785051+0000","last_peered":"2024-04-14T11:08:11.785051+0000","last_clean":"2024-04-14T11:08:11.785051+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T11:08:11.785051+0000","last_undegraded":"2024-04-14T11:08:11.785051+0000","last_fullsized":"2024-04-14T11:08:11.785051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":258,"num_write_kb":50068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"37'1086","reported_seq":3186,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.720588+0000","last_change":"2024-04-14T11:01:46.215203+0000","last_active":"2024-04-14T11:08:12.720588+0000","last_peered":"2024-04-14T11:08:12.720588+0000","last_clean":"2024-04-14T11:08:12.720588+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T11:08:12.720588+0000","last_undegraded":"2024-04-14T11:08:12.720588+0000","last_fullsized":"2024-04-14T11:08:12.720588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:22:25.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022432480000000002,"stat_sum":{"num_bytes":15941659,"num_objects":393,"num_object_clones":182,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":182,"num_read":206,"num_read_kb":4126,"num_write":879,"num_write_kb":18711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"37'768","reported_seq":1348,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.712753+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T11:08:13.712753+0000","last_peered":"2024-04-14T11:08:13.712753+0000","last_clean":"2024-04-14T11:08:13.712753+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T11:08:13.712753+0000","last_undegraded":"2024-04-14T11:08:13.712753+0000","last_fullsized":"2024-04-14T11:08:13.712753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24675831,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":540,"num_read_kb":3961,"num_write":774,"num_write_kb":49873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'1173","reported_seq":3436,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.743338+0000","last_change":"2024-04-14T11:01:46.055054+0000","last_active":"2024-04-14T11:08:12.743338+0000","last_peered":"2024-04-14T11:08:12.743338+0000","last_clean":"2024-04-14T11:08:12.743338+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T11:08:12.743338+0000","last_undegraded":"2024-04-14T11:08:12.743338+0000","last_fullsized":"2024-04-14T11:08:12.743338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:24:18.724472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016065350000000001,"stat_sum":{"num_bytes":12135704,"num_objects":441,"num_object_clones":205,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441,"num_whiteouts":205,"num_read":391,"num_read_kb":5329,"num_write":943,"num_write_kb":13900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'243","reported_seq":295,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.376131+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T11:08:14.376131+0000","last_peered":"2024-04-14T11:08:14.376131+0000","last_clean":"2024-04-14T11:08:14.376131+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T11:08:14.376131+0000","last_undegraded":"2024-04-14T11:08:14.376131+0000","last_fullsized":"2024-04-14T11:08:14.376131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":254,"num_write_kb":49815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"37'1184","reported_seq":3236,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.936735+0000","last_change":"2024-04-14T11:01:46.055964+0000","last_active":"2024-04-14T11:08:12.936735+0000","last_peered":"2024-04-14T11:08:12.936735+0000","last_clean":"2024-04-14T11:08:12.936735+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T11:08:12.936735+0000","last_undegraded":"2024-04-14T11:08:12.936735+0000","last_fullsized":"2024-04-14T11:08:12.936735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1184,"log_dups_size":0,"ondisk_log_size":1184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:33:26.748215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011886729999999999,"stat_sum":{"num_bytes":12719680,"num_objects":421,"num_object_clones":196,"num_object_copies":842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":196,"num_read":172,"num_read_kb":4962,"num_write":972,"num_write_kb":15502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"37'308","reported_seq":360,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.784782+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T11:08:11.784782+0000","last_peered":"2024-04-14T11:08:11.784782+0000","last_clean":"2024-04-14T11:08:11.784782+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T11:08:11.784782+0000","last_undegraded":"2024-04-14T11:08:11.784782+0000","last_fullsized":"2024-04-14T11:08:11.784782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":303,"num_write_kb":45716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"37'1186","reported_seq":4415,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.899364+0000","last_change":"2024-04-14T11:01:46.058738+0000","last_active":"2024-04-14T11:08:12.899364+0000","last_peered":"2024-04-14T11:08:12.899364+0000","last_clean":"2024-04-14T11:08:12.899364+0000","last_became_active":"2024-04-14T10:58:44.521016+0000","last_became_peered":"2024-04-14T10:58:44.521016+0000","last_unstale":"2024-04-14T11:08:12.899364+0000","last_undegraded":"2024-04-14T11:08:12.899364+0000","last_fullsized":"2024-04-14T11:08:12.899364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1186,"log_dups_size":0,"ondisk_log_size":1186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:47:30.020829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038959760000000002,"stat_sum":{"num_bytes":33623883,"num_objects":431,"num_object_clones":187,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":187,"num_read":1335,"num_read_kb":21513,"num_write":969,"num_write_kb":40119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"37'257","reported_seq":309,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.566735+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T11:08:13.566735+0000","last_peered":"2024-04-14T11:08:13.566735+0000","last_clean":"2024-04-14T11:08:13.566735+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T11:08:13.566735+0000","last_undegraded":"2024-04-14T11:08:13.566735+0000","last_fullsized":"2024-04-14T11:08:13.566735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":270,"num_write_kb":37694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"37'1166","reported_seq":3425,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.728936+0000","last_change":"2024-04-14T11:01:46.055103+0000","last_active":"2024-04-14T11:08:13.728936+0000","last_peered":"2024-04-14T11:08:13.728936+0000","last_clean":"2024-04-14T11:08:13.728936+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T11:08:13.728936+0000","last_undegraded":"2024-04-14T11:08:13.728936+0000","last_fullsized":"2024-04-14T11:08:13.728936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:29:12.622348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016395820000000001,"stat_sum":{"num_bytes":20085455,"num_objects":430,"num_object_clones":197,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":430,"num_whiteouts":197,"num_read":380,"num_read_kb":6909,"num_write":950,"num_write_kb":21700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"37'511","reported_seq":563,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.808781+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T11:08:15.808781+0000","last_peered":"2024-04-14T11:08:15.808781+0000","last_clean":"2024-04-14T11:08:15.808781+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T11:08:15.808781+0000","last_undegraded":"2024-04-14T11:08:15.808781+0000","last_fullsized":"2024-04-14T11:08:15.808781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1069,"num_write_kb":32651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"37'1117","reported_seq":3014,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.721329+0000","last_change":"2024-04-14T11:01:46.639876+0000","last_active":"2024-04-14T11:08:12.721329+0000","last_peered":"2024-04-14T11:08:12.721329+0000","last_clean":"2024-04-14T11:08:12.721329+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T11:08:12.721329+0000","last_undegraded":"2024-04-14T11:08:12.721329+0000","last_fullsized":"2024-04-14T11:08:12.721329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:39:13.715767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00265679,"stat_sum":{"num_bytes":5503393,"num_objects":415,"num_object_clones":195,"num_object_copies":830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":415,"num_whiteouts":195,"num_read":16,"num_read_kb":16,"num_write":906,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"37'272","reported_seq":324,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.783867+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T11:08:11.783867+0000","last_peered":"2024-04-14T11:08:11.783867+0000","last_clean":"2024-04-14T11:08:11.783867+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T11:08:11.783867+0000","last_undegraded":"2024-04-14T11:08:11.783867+0000","last_fullsized":"2024-04-14T11:08:11.783867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":310,"num_write_kb":25219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"37'1144","reported_seq":3163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.751234+0000","last_change":"2024-04-14T11:01:46.214667+0000","last_active":"2024-04-14T11:08:13.751234+0000","last_peered":"2024-04-14T11:08:13.751234+0000","last_clean":"2024-04-14T11:08:13.751234+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T11:08:13.751234+0000","last_undegraded":"2024-04-14T11:08:13.751234+0000","last_fullsized":"2024-04-14T11:08:13.751234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1144,"log_dups_size":0,"ondisk_log_size":1144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:59:01.354463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018052999999999999,"stat_sum":{"num_bytes":6929899,"num_objects":402,"num_object_clones":185,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":185,"num_read":129,"num_read_kb":3168,"num_write":934,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"37'274","reported_seq":326,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.785069+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T11:08:11.785069+0000","last_peered":"2024-04-14T11:08:11.785069+0000","last_clean":"2024-04-14T11:08:11.785069+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T11:08:11.785069+0000","last_undegraded":"2024-04-14T11:08:11.785069+0000","last_fullsized":"2024-04-14T11:08:11.785069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":271,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"37'1134","reported_seq":3997,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.734906+0000","last_change":"2024-04-14T11:01:46.056373+0000","last_active":"2024-04-14T11:08:12.734906+0000","last_peered":"2024-04-14T11:08:12.734906+0000","last_clean":"2024-04-14T11:08:12.734906+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T11:08:12.734906+0000","last_undegraded":"2024-04-14T11:08:12.734906+0000","last_fullsized":"2024-04-14T11:08:12.734906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:12:27.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001467014,"stat_sum":{"num_bytes":23716624,"num_objects":409,"num_object_clones":187,"num_object_copies":818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":409,"num_whiteouts":187,"num_read":974,"num_read_kb":19247,"num_write":919,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"37'353","reported_seq":405,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.938172+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T11:08:12.938172+0000","last_peered":"2024-04-14T11:08:12.938172+0000","last_clean":"2024-04-14T11:08:12.938172+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T11:08:12.938172+0000","last_undegraded":"2024-04-14T11:08:12.938172+0000","last_fullsized":"2024-04-14T11:08:12.938172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":349,"num_write_kb":21242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'1210","reported_seq":3576,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.738553+0000","last_change":"2024-04-14T11:01:46.640816+0000","last_active":"2024-04-14T11:08:12.738553+0000","last_peered":"2024-04-14T11:08:12.738553+0000","last_clean":"2024-04-14T11:08:12.738553+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T11:08:12.738553+0000","last_undegraded":"2024-04-14T11:08:12.738553+0000","last_fullsized":"2024-04-14T11:08:12.738553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:47:30.020829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003171901,"stat_sum":{"num_bytes":16160611,"num_objects":435,"num_object_clones":202,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":202,"num_read":492,"num_read_kb":8176,"num_write":983,"num_write_kb":22461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"37'682","reported_seq":734,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.932965+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T11:08:12.932965+0000","last_peered":"2024-04-14T11:08:12.932965+0000","last_clean":"2024-04-14T11:08:12.932965+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T11:08:12.932965+0000","last_undegraded":"2024-04-14T11:08:12.932965+0000","last_fullsized":"2024-04-14T11:08:12.932965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":678,"num_write_kb":45877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"37'1125","reported_seq":3404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.735492+0000","last_change":"2024-04-14T11:01:46.640533+0000","last_active":"2024-04-14T11:08:13.735492+0000","last_peered":"2024-04-14T11:08:13.735492+0000","last_clean":"2024-04-14T11:08:13.735492+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T11:08:13.735492+0000","last_undegraded":"2024-04-14T11:08:13.735492+0000","last_fullsized":"2024-04-14T11:08:13.735492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:55:56.034934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032651109999999998,"stat_sum":{"num_bytes":12406418,"num_objects":403,"num_object_clones":183,"num_object_copies":806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":403,"num_whiteouts":183,"num_read":386,"num_read_kb":8577,"num_write":914,"num_write_kb":14025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"37'418","reported_seq":470,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.937768+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T11:08:12.937768+0000","last_peered":"2024-04-14T11:08:12.937768+0000","last_clean":"2024-04-14T11:08:12.937768+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T11:08:12.937768+0000","last_undegraded":"2024-04-14T11:08:12.937768+0000","last_fullsized":"2024-04-14T11:08:12.937768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":445,"num_write_kb":37732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"37'1176","reported_seq":3256,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.757447+0000","last_change":"2024-04-14T11:01:46.321158+0000","last_active":"2024-04-14T11:08:13.757447+0000","last_peered":"2024-04-14T11:08:13.757447+0000","last_clean":"2024-04-14T11:08:13.757447+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T11:08:13.757447+0000","last_undegraded":"2024-04-14T11:08:13.757447+0000","last_fullsized":"2024-04-14T11:08:13.757447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:24:18.724472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019271749999999999,"stat_sum":{"num_bytes":8320793,"num_objects":424,"num_object_clones":197,"num_object_copies":848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":424,"num_whiteouts":197,"num_read":201,"num_read_kb":4193,"num_write":954,"num_write_kb":14088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"37'1113","reported_seq":3675,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.743048+0000","last_change":"2024-04-14T11:01:46.448153+0000","last_active":"2024-04-14T11:08:12.743048+0000","last_peered":"2024-04-14T11:08:12.743048+0000","last_clean":"2024-04-14T11:08:12.743048+0000","last_became_active":"2024-04-14T10:58:44.514340+0000","last_became_peered":"2024-04-14T10:58:44.514340+0000","last_unstale":"2024-04-14T11:08:12.743048+0000","last_undegraded":"2024-04-14T11:08:12.743048+0000","last_fullsized":"2024-04-14T11:08:12.743048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:50:33.276616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077277900000000002,"stat_sum":{"num_bytes":20624331,"num_objects":409,"num_object_clones":192,"num_object_copies":818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":409,"num_whiteouts":192,"num_read":685,"num_read_kb":17247,"num_write":900,"num_write_kb":26862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"37'236","reported_seq":288,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374572+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T11:08:14.374572+0000","last_peered":"2024-04-14T11:08:14.374572+0000","last_clean":"2024-04-14T11:08:14.374572+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T11:08:14.374572+0000","last_undegraded":"2024-04-14T11:08:14.374572+0000","last_fullsized":"2024-04-14T11:08:14.374572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":243,"num_write_kb":41692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'1260","reported_seq":3115,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.738109+0000","last_change":"2024-04-14T11:01:46.059613+0000","last_active":"2024-04-14T11:08:12.738109+0000","last_peered":"2024-04-14T11:08:12.738109+0000","last_clean":"2024-04-14T11:08:12.738109+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T11:08:12.738109+0000","last_undegraded":"2024-04-14T11:08:12.738109+0000","last_fullsized":"2024-04-14T11:08:12.738109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:53:36.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003375477,"stat_sum":{"num_bytes":4165041,"num_objects":499,"num_object_clones":234,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":234,"num_read":13,"num_read_kb":13,"num_write":1007,"num_write_kb":10901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"37'433","reported_seq":485,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.784120+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T11:08:11.784120+0000","last_peered":"2024-04-14T11:08:11.784120+0000","last_clean":"2024-04-14T11:08:11.784120+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T11:08:11.784120+0000","last_undegraded":"2024-04-14T11:08:11.784120+0000","last_fullsized":"2024-04-14T11:08:11.784120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":435,"num_write_kb":66338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"37'1122","reported_seq":3770,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.764344+0000","last_change":"2024-04-14T11:01:46.447900+0000","last_active":"2024-04-14T11:08:13.764344+0000","last_peered":"2024-04-14T11:08:13.764344+0000","last_clean":"2024-04-14T11:08:13.764344+0000","last_became_active":"2024-04-14T10:58:44.515250+0000","last_became_peered":"2024-04-14T10:58:44.515250+0000","last_unstale":"2024-04-14T11:08:13.764344+0000","last_undegraded":"2024-04-14T11:08:13.764344+0000","last_fullsized":"2024-04-14T11:08:13.764344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1122,"log_dups_size":0,"ondisk_log_size":1122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:45:31.110918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089051500000000003,"stat_sum":{"num_bytes":17489818,"num_objects":435,"num_object_clones":203,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":203,"num_read":781,"num_read_kb":14803,"num_write":899,"num_write_kb":18515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"37'580","reported_seq":633,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.815545+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T11:08:15.815545+0000","last_peered":"2024-04-14T11:08:15.815545+0000","last_clean":"2024-04-14T11:08:15.815545+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T11:08:15.815545+0000","last_undegraded":"2024-04-14T11:08:15.815545+0000","last_fullsized":"2024-04-14T11:08:15.815545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12642331,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":569,"num_write_kb":41754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'1114","reported_seq":3150,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942396+0000","last_change":"2024-04-14T11:01:46.640496+0000","last_active":"2024-04-14T11:08:15.942396+0000","last_peered":"2024-04-14T11:08:15.942396+0000","last_clean":"2024-04-14T11:08:15.942396+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T11:08:15.942396+0000","last_undegraded":"2024-04-14T11:08:15.942396+0000","last_fullsized":"2024-04-14T11:08:15.942396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:38.030909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032321239999999998,"stat_sum":{"num_bytes":7637967,"num_objects":402,"num_object_clones":183,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":183,"num_read":142,"num_read_kb":4108,"num_write":908,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"37'392","reported_seq":444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.756195+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T11:08:15.756195+0000","last_peered":"2024-04-14T11:08:15.756195+0000","last_clean":"2024-04-14T11:08:15.756195+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T11:08:15.756195+0000","last_undegraded":"2024-04-14T11:08:15.756195+0000","last_fullsized":"2024-04-14T11:08:15.756195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":397,"num_write_kb":17248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1014283614,"num_objects":27782,"num_object_clones":12826,"num_object_copies":55564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27782,"num_whiteouts":12700,"num_read":30594,"num_read_kb":671228,"num_write":60516,"num_write_kb":1315345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2096480256,"data_stored":2029975296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74796,"ondisk_log_size":74796,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":570002365,"num_objects":1310,"num_object_clones":0,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":913,"num_read_kb":3961,"num_write":14124,"num_write_kb":1279263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1140154368,"data_stored":1140004730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13243,"ondisk_log_size":13243,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":490160,"kb_used_data":409000,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93881680,"statfs":{"total":96636764160,"available":96134840320,"internally_reserved":0,"allocated":418816000,"data_stored":409229671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446800,"kb_used_data":365704,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93925040,"statfs":{"total":96636764160,"available":96179240960,"internally_reserved":0,"allocated":374480896,"data_stored":367459550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":485212,"kb_used_data":404052,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93886628,"statfs":{"total":96636764160,"available":96139907072,"internally_reserved":0,"allocated":413749248,"data_stored":404010765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":500152,"kb_used_data":414832,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93871688,"statfs":{"total":96636764160,"available":96124608512,"internally_reserved":0,"allocated":424787968,"data_stored":415215258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":568516,"kb_used_data":479036,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":93803324,"statfs":{"total":96636764160,"available":96054603776,"internally_reserved":0,"allocated":490532864,"data_stored":480451852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":91617735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345828,"kb_used_data":296604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94026012,"statfs":{"total":96636764160,"available":96282636288,"internally_reserved":0,"allocated":303722496,"data_stored":297693489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":459072,"kb_used_data":377976,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93912768,"statfs":{"total":96636764160,"available":96166674432,"internally_reserved":0,"allocated":387047424,"data_stored":380077165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503284,"kb_used_data":417964,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93868556,"statfs":{"total":96636764160,"available":96121401344,"internally_reserved":0,"allocated":427995136,"data_stored":418467186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":104935424,"data_stored":104917679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":125853696,"data_stored":125832585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":91807744,"data_stored":91785423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":188338176,"data_stored":188314841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":121651200,"data_stored":121638492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":142626816,"data_stored":142607714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":192954368,"data_stored":192939775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171968221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":322052096,"data_stored":312778564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260780032,"data_stored":254064005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":211501056,"data_stored":205727491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":301780992,"data_stored":291956862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":302723072,"data_stored":293396191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":270708736,"data_stored":261222476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":181112832,"data_stored":174339200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":245821440,"data_stored":236490507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T11:08:18.192 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T11:08:18.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.335+0000 7fc7c7e60640 1 Processor -- start 2024-04-14T11:08:18.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.335+0000 7fc7c7e60640 1 -- start start 2024-04-14T11:08:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c7e60640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7c01551d0 0x7fc7c006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c7e60640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7c00ce320 0x7fc7c00ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c7e60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c015cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c7e60640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c015d0b0 con 0x7fc7c00ce320 2024-04-14T11:08:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c7e60640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c015acd0 con 0x7fc7c01551d0 2024-04-14T11:08:18.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c7e60640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c015af70 con 0x7fc7c015c6e0 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7c00ce320 0x7fc7c00ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7fc7c00ce320 0x7fc7c00ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59716/0 (socket says 172.21.15.84:59716) 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 -- 172.21.15.84:0/2619167922 learned_addr learned my addr 172.21.15.84:0/2619167922 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c5bfc640 1 --2- 172.21.15.84:0/2619167922 >> v2:172.21.15.175:3300/0 conn(0x7fc7c01551d0 0x7fc7c006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c63fd640 1 --2- 172.21.15.84:0/2619167922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c015cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 -- 172.21.15.84:0/2619167922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 msgr2=0x7fc7c015cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 --2- 172.21.15.84:0/2619167922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c015cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 -- 172.21.15.84:0/2619167922 >> v2:172.21.15.175:3300/0 conn(0x7fc7c01551d0 msgr2=0x7fc7c006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 --2- 172.21.15.84:0/2619167922 >> v2:172.21.15.175:3300/0 conn(0x7fc7c01551d0 0x7fc7c006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.336+0000 7fc7c53fb640 1 -- 172.21.15.84:0/2619167922 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c015b210 con 0x7fc7c00ce320 2024-04-14T11:08:18.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.337+0000 7fc7c53fb640 1 --2- 172.21.15.84:0/2619167922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c00ce320 0x7fc7c00ce750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0072df0 tx=0x7fc7b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c9bb5eaf353659 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.337+0000 7fc7c4bfa640 1 -- 172.21.15.84:0/2619167922 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0034070 con 0x7fc7c00ce320 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.337+0000 7fc7c4bfa640 1 -- 172.21.15.84:0/2619167922 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0030860 con 0x7fc7c00ce320 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.337+0000 7fc7c4bfa640 1 -- 172.21.15.84:0/2619167922 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0030c30 con 0x7fc7c00ce320 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 -- 172.21.15.84:0/2619167922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c00ce320 msgr2=0x7fc7c00ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/2619167922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c00ce320 0x7fc7c00ce750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0072df0 tx=0x7fc7b002b9a0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 -- 172.21.15.84:0/2619167922 shutdown_connections 2024-04-14T11:08:18.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/2619167922 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c015cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/2619167922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c00ce320 0x7fc7c00ce750 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/2619167922 >> v2:172.21.15.175:3300/0 conn(0x7fc7c01551d0 0x7fc7c006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 -- 172.21.15.84:0/2619167922 >> 172.21.15.84:0/2619167922 conn(0x7fc7c006db10 msgr2=0x7fc7c006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 -- 172.21.15.84:0/2619167922 shutdown_connections 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.338+0000 7fc7c7e60640 1 -- 172.21.15.84:0/2619167922 wait complete. 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.339+0000 7fc7c7e60640 1 Processor -- start 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.339+0000 7fc7c7e60640 1 -- start start 2024-04-14T11:08:18.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c00ce320 0x7fc7c0071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 0x7fc7c00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c00cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c015bab0 con 0x7fc7c01551d0 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c015b7d0 con 0x7fc7c00ce320 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c015c1c0 con 0x7fc7c015c6e0 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 0x7fc7c00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 0x7fc7c00cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59732/0 (socket says 172.21.15.84:59732) 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 -- 172.21.15.84:0/684810407 learned_addr learned my addr 172.21.15.84:0/684810407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:18.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c5bfc640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c00ce320 0x7fc7c0071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c63fd640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c00cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 -- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 msgr2=0x7fc7c00cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c00cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 -- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c00ce320 msgr2=0x7fc7c0071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c00ce320 0x7fc7c0071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 -- 172.21.15.84:0/684810407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c00cc230 con 0x7fc7c01551d0 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c53fb640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 0x7fc7c00cccd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00097c0 tx=0x7fc7b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:18.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0034040 con 0x7fc7c01551d0 2024-04-14T11:08:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0039d90 con 0x7fc7c01551d0 2024-04-14T11:08:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c01f15f0 con 0x7fc7c01551d0 2024-04-14T11:08:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00433f0 con 0x7fc7c01551d0 2024-04-14T11:08:18.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.340+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c00c4610 con 0x7fc7c01551d0 2024-04-14T11:08:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.342+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c0069c30 con 0x7fc7c01551d0 2024-04-14T11:08:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.342+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc7b004a060 con 0x7fc7c01551d0 2024-04-14T11:08:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.342+0000 7fc7b67fc640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7a406c920 0x7fc7a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.342+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7fc7b00ada80 con 0x7fc7c01551d0 2024-04-14T11:08:18.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.342+0000 7fc7c5bfc640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7a406c920 0x7fc7a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.343+0000 7fc7c5bfc640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7a406c920 0x7fc7a406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009ac0 tx=0x7fc7bc009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:18.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.347+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7fc7b003e070 con 0x7fc7c01551d0 2024-04-14T11:08:18.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.519+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7c0152610 con 0x7fc7a406c920 2024-04-14T11:08:18.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.525+0000 7fc7b67fc640 1 -- 172.21.15.84:0/684810407 <== mgr.4113 v2:172.21.15.84:6832/921762080 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+256910 (secure 0 0 0) 0x7fc7c0152610 con 0x7fc7a406c920 2024-04-14T11:08:18.518 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-14T11:08:18.519 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-04-14T11:08:18.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7a406c920 msgr2=0x7fc7a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7a406c920 0x7fc7a406ede0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009ac0 tx=0x7fc7bc009190 comp rx=0 tx=0).stop 2024-04-14T11:08:18.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 msgr2=0x7fc7c00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 0x7fc7c00cccd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00097c0 tx=0x7fc7b00046c0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 shutdown_connections 2024-04-14T11:08:18.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7fc7a406c920 0x7fc7a406ede0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c015c6e0 0x7fc7c00cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc7c01551d0 0x7fc7c00cccd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 --2- 172.21.15.84:0/684810407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c00ce320 0x7fc7c0071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 >> 172.21.15.84:0/684810407 conn(0x7fc7c006db10 msgr2=0x7fc7c00ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:18.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 shutdown_connections 2024-04-14T11:08:18.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.528+0000 7fc7c7e60640 1 -- 172.21.15.84:0/684810407 wait complete. 2024-04-14T11:08:18.530 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-14T11:08:17.523842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1584876347,"num_objects":29094,"num_object_clones":12826,"num_object_copies":58188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29094,"num_whiteouts":12700,"num_read":31623,"num_read_kb":675289,"num_write":74799,"num_write_kb":2597024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88156,"ondisk_log_size":88156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3799024,"kb_used_data":3165168,"kb_used_omap":12,"kb_used_meta":633779,"kb_avail":751175696,"statfs":{"total":773094113280,"available":769203912704,"internally_reserved":0,"allocated":3241132032,"data_stored":3172604936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":648990257},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-71349415,"num_objects":1171,"num_object_clones":472,"num_object_copies":2342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1171,"num_whiteouts":466,"num_read":58,"num_read_kb":75,"num_write":1980,"num_write_kb":84158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":135,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002257"},"pg_stats":[{"pgid":"3.3f","version":"37'1097","reported_seq":3322,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.755682+0000","last_change":"2024-04-14T11:01:46.137250+0000","last_active":"2024-04-14T11:08:13.755682+0000","last_peered":"2024-04-14T11:08:13.755682+0000","last_clean":"2024-04-14T11:08:13.755682+0000","last_became_active":"2024-04-14T10:58:04.208805+0000","last_became_peered":"2024-04-14T10:58:04.208805+0000","last_unstale":"2024-04-14T11:08:13.755682+0000","last_undegraded":"2024-04-14T11:08:13.755682+0000","last_fullsized":"2024-04-14T11:08:13.755682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:47:33.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002702369,"stat_sum":{"num_bytes":11466954,"num_objects":386,"num_object_clones":177,"num_object_copies":772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":177,"num_read":326,"num_read_kb":8995,"num_write":901,"num_write_kb":13037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'1129","reported_seq":3186,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.737886+0000","last_change":"2024-04-14T11:01:46.055486+0000","last_active":"2024-04-14T11:08:12.737886+0000","last_peered":"2024-04-14T11:08:12.737886+0000","last_clean":"2024-04-14T11:08:12.737886+0000","last_became_active":"2024-04-14T10:58:04.201796+0000","last_became_peered":"2024-04-14T10:58:04.201796+0000","last_unstale":"2024-04-14T11:08:12.737886+0000","last_undegraded":"2024-04-14T11:08:12.737886+0000","last_fullsized":"2024-04-14T11:08:12.737886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:16.820507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018522059999999999,"stat_sum":{"num_bytes":15285159,"num_objects":416,"num_object_clones":193,"num_object_copies":832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":416,"num_whiteouts":193,"num_read":174,"num_read_kb":4372,"num_write":908,"num_write_kb":16897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"37'1144","reported_seq":3270,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.724898+0000","last_change":"2024-04-14T11:01:46.214621+0000","last_active":"2024-04-14T11:08:13.724898+0000","last_peered":"2024-04-14T11:08:13.724898+0000","last_clean":"2024-04-14T11:08:13.724898+0000","last_became_active":"2024-04-14T10:58:04.200770+0000","last_became_peered":"2024-04-14T10:58:04.200770+0000","last_unstale":"2024-04-14T11:08:13.724898+0000","last_undegraded":"2024-04-14T11:08:13.724898+0000","last_fullsized":"2024-04-14T11:08:13.724898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1144,"log_dups_size":0,"ondisk_log_size":1144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:29:00.074559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001809642,"stat_sum":{"num_bytes":11725385,"num_objects":431,"num_object_clones":196,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":196,"num_read":246,"num_read_kb":12679,"num_write":923,"num_write_kb":26638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"37'1152","reported_seq":3409,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.938512+0000","last_change":"2024-04-14T11:01:46.059362+0000","last_active":"2024-04-14T11:08:12.938512+0000","last_peered":"2024-04-14T11:08:12.938512+0000","last_clean":"2024-04-14T11:08:12.938512+0000","last_became_active":"2024-04-14T10:58:04.205809+0000","last_became_peered":"2024-04-14T10:58:04.205809+0000","last_unstale":"2024-04-14T11:08:12.938512+0000","last_undegraded":"2024-04-14T11:08:12.938512+0000","last_fullsized":"2024-04-14T11:08:12.938512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:28:57.912397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033563579999999998,"stat_sum":{"num_bytes":12325249,"num_objects":434,"num_object_clones":202,"num_object_copies":868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":434,"num_whiteouts":202,"num_read":382,"num_read_kb":9143,"num_write":933,"num_write_kb":15459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"37'1225","reported_seq":3678,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.786256+0000","last_change":"2024-04-14T11:01:46.055307+0000","last_active":"2024-04-14T11:08:12.786256+0000","last_peered":"2024-04-14T11:08:12.786256+0000","last_clean":"2024-04-14T11:08:12.786256+0000","last_became_active":"2024-04-14T10:58:44.516419+0000","last_became_peered":"2024-04-14T10:58:44.516419+0000","last_unstale":"2024-04-14T11:08:12.786256+0000","last_undegraded":"2024-04-14T11:08:12.786256+0000","last_fullsized":"2024-04-14T11:08:12.786256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:44:39.578365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016155729999999999,"stat_sum":{"num_bytes":17309501,"num_objects":446,"num_object_clones":205,"num_object_copies":892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":446,"num_whiteouts":205,"num_read":589,"num_read_kb":14854,"num_write":1006,"num_write_kb":18535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"37'1112","reported_seq":3163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.741545+0000","last_change":"2024-04-14T11:01:46.058846+0000","last_active":"2024-04-14T11:08:13.741545+0000","last_peered":"2024-04-14T11:08:13.741545+0000","last_clean":"2024-04-14T11:08:13.741545+0000","last_became_active":"2024-04-14T10:58:04.201421+0000","last_became_peered":"2024-04-14T10:58:04.201421+0000","last_unstale":"2024-04-14T11:08:13.741545+0000","last_undegraded":"2024-04-14T11:08:13.741545+0000","last_fullsized":"2024-04-14T11:08:13.741545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1112,"log_dups_size":0,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:47:33.731633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036241149999999998,"stat_sum":{"num_bytes":12259772,"num_objects":395,"num_object_clones":183,"num_object_copies":790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":395,"num_whiteouts":183,"num_read":158,"num_read_kb":5715,"num_write":915,"num_write_kb":13761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"37'1182","reported_seq":3735,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.747325+0000","last_change":"2024-04-14T11:01:46.135483+0000","last_active":"2024-04-14T11:08:13.747325+0000","last_peered":"2024-04-14T11:08:13.747325+0000","last_clean":"2024-04-14T11:08:13.747325+0000","last_became_active":"2024-04-14T10:58:04.209654+0000","last_became_peered":"2024-04-14T10:58:04.209654+0000","last_unstale":"2024-04-14T11:08:13.747325+0000","last_undegraded":"2024-04-14T11:08:13.747325+0000","last_fullsized":"2024-04-14T11:08:13.747325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:18.646219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017791149999999999,"stat_sum":{"num_bytes":20779107,"num_objects":439,"num_object_clones":202,"num_object_copies":878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":439,"num_whiteouts":202,"num_read":679,"num_read_kb":18773,"num_write":953,"num_write_kb":21796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"37'1113","reported_seq":4044,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.722997+0000","last_change":"2024-04-14T11:01:46.639827+0000","last_active":"2024-04-14T11:08:13.722997+0000","last_peered":"2024-04-14T11:08:13.722997+0000","last_clean":"2024-04-14T11:08:13.722997+0000","last_became_active":"2024-04-14T10:58:04.205313+0000","last_became_peered":"2024-04-14T10:58:04.205313+0000","last_unstale":"2024-04-14T11:08:13.722997+0000","last_undegraded":"2024-04-14T11:08:13.722997+0000","last_fullsized":"2024-04-14T11:08:13.722997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:30:29.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026442850000000001,"stat_sum":{"num_bytes":37195203,"num_objects":415,"num_object_clones":187,"num_object_copies":830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":415,"num_whiteouts":187,"num_read":1042,"num_read_kb":24039,"num_write":909,"num_write_kb":38397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"37'1177","reported_seq":3444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.749307+0000","last_change":"2024-04-14T11:01:46.137193+0000","last_active":"2024-04-14T11:08:13.749307+0000","last_peered":"2024-04-14T11:08:13.749307+0000","last_clean":"2024-04-14T11:08:13.749307+0000","last_became_active":"2024-04-14T10:58:44.523574+0000","last_became_peered":"2024-04-14T10:58:44.523574+0000","last_unstale":"2024-04-14T11:08:13.749307+0000","last_undegraded":"2024-04-14T11:08:13.749307+0000","last_fullsized":"2024-04-14T11:08:13.749307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:39.135097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024897719999999999,"stat_sum":{"num_bytes":13063323,"num_objects":437,"num_object_clones":203,"num_object_copies":874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":437,"num_whiteouts":203,"num_read":389,"num_read_kb":13906,"num_write":941,"num_write_kb":19099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"37'1116","reported_seq":3006,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.721269+0000","last_change":"2024-04-14T11:01:46.321779+0000","last_active":"2024-04-14T11:08:12.721269+0000","last_peered":"2024-04-14T11:08:12.721269+0000","last_clean":"2024-04-14T11:08:12.721269+0000","last_became_active":"2024-04-14T10:58:04.208724+0000","last_became_peered":"2024-04-14T10:58:04.208724+0000","last_unstale":"2024-04-14T11:08:12.721269+0000","last_undegraded":"2024-04-14T11:08:12.721269+0000","last_fullsized":"2024-04-14T11:08:12.721269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:06:16.180543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021398879999999999,"stat_sum":{"num_bytes":2922684,"num_objects":433,"num_object_clones":202,"num_object_copies":866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":433,"num_whiteouts":202,"num_read":16,"num_read_kb":16,"num_write":886,"num_write_kb":9099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"37'1154","reported_seq":3557,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.731371+0000","last_change":"2024-04-14T11:01:46.321654+0000","last_active":"2024-04-14T11:08:13.731371+0000","last_peered":"2024-04-14T11:08:13.731371+0000","last_clean":"2024-04-14T11:08:13.731371+0000","last_became_active":"2024-04-14T10:58:04.209421+0000","last_became_peered":"2024-04-14T10:58:04.209421+0000","last_unstale":"2024-04-14T11:08:13.731371+0000","last_undegraded":"2024-04-14T11:08:13.731371+0000","last_fullsized":"2024-04-14T11:08:13.731371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1154,"log_dups_size":0,"ondisk_log_size":1154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:29:12.622348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022578479999999998,"stat_sum":{"num_bytes":12638856,"num_objects":474,"num_object_clones":217,"num_object_copies":948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":474,"num_whiteouts":217,"num_read":544,"num_read_kb":8006,"num_write":928,"num_write_kb":13550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"37'1153","reported_seq":3475,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.133623+0000","last_change":"2024-04-14T11:01:46.056861+0000","last_active":"2024-04-14T11:08:13.133623+0000","last_peered":"2024-04-14T11:08:13.133623+0000","last_clean":"2024-04-14T11:08:13.133623+0000","last_became_active":"2024-04-14T10:58:04.204908+0000","last_became_peered":"2024-04-14T10:58:04.204908+0000","last_unstale":"2024-04-14T11:08:13.133623+0000","last_undegraded":"2024-04-14T11:08:13.133623+0000","last_fullsized":"2024-04-14T11:08:13.133623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:29:13.953041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012594800000000001,"stat_sum":{"num_bytes":24222591,"num_objects":453,"num_object_clones":206,"num_object_copies":906,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":206,"num_read":452,"num_read_kb":8461,"num_write":934,"num_write_kb":30738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"37'1128","reported_seq":3491,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.938605+0000","last_change":"2024-04-14T11:01:46.639627+0000","last_active":"2024-04-14T11:08:12.938605+0000","last_peered":"2024-04-14T11:08:12.938605+0000","last_clean":"2024-04-14T11:08:12.938605+0000","last_became_active":"2024-04-14T10:58:04.205512+0000","last_became_peered":"2024-04-14T10:58:04.205512+0000","last_unstale":"2024-04-14T11:08:12.938605+0000","last_undegraded":"2024-04-14T11:08:12.938605+0000","last_fullsized":"2024-04-14T11:08:12.938605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1128,"log_dups_size":0,"ondisk_log_size":1128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:18:05.684403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025722029999999999,"stat_sum":{"num_bytes":11961153,"num_objects":440,"num_object_clones":203,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":203,"num_read":490,"num_read_kb":13560,"num_write":896,"num_write_kb":22652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"37'1184","reported_seq":3982,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.922968+0000","last_change":"2024-04-14T11:01:46.214395+0000","last_active":"2024-04-14T11:08:12.922968+0000","last_peered":"2024-04-14T11:08:12.922968+0000","last_clean":"2024-04-14T11:08:12.922968+0000","last_became_active":"2024-04-14T10:58:04.205785+0000","last_became_peered":"2024-04-14T10:58:04.205785+0000","last_unstale":"2024-04-14T11:08:12.922968+0000","last_undegraded":"2024-04-14T11:08:12.922968+0000","last_fullsized":"2024-04-14T11:08:12.922968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1184,"log_dups_size":0,"ondisk_log_size":1184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:34:12.286438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001618658,"stat_sum":{"num_bytes":20313431,"num_objects":451,"num_object_clones":206,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":206,"num_read":928,"num_read_kb":9674,"num_write":949,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'1160","reported_seq":4444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.732122+0000","last_change":"2024-04-14T11:01:46.055304+0000","last_active":"2024-04-14T11:08:12.732122+0000","last_peered":"2024-04-14T11:08:12.732122+0000","last_clean":"2024-04-14T11:08:12.732122+0000","last_became_active":"2024-04-14T10:58:04.198068+0000","last_became_peered":"2024-04-14T10:58:04.198068+0000","last_unstale":"2024-04-14T11:08:12.732122+0000","last_undegraded":"2024-04-14T11:08:12.732122+0000","last_fullsized":"2024-04-14T11:08:12.732122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:06:16.180543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018964279999999999,"stat_sum":{"num_bytes":25560468,"num_objects":407,"num_object_clones":183,"num_object_copies":814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":407,"num_whiteouts":183,"num_read":1391,"num_read_kb":21375,"num_write":955,"num_write_kb":27967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"37'1196","reported_seq":4285,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.734714+0000","last_change":"2024-04-14T11:01:46.058500+0000","last_active":"2024-04-14T11:08:13.734714+0000","last_peered":"2024-04-14T11:08:13.734714+0000","last_clean":"2024-04-14T11:08:13.734714+0000","last_became_active":"2024-04-14T10:58:04.203362+0000","last_became_peered":"2024-04-14T10:58:04.203362+0000","last_unstale":"2024-04-14T11:08:13.734714+0000","last_undegraded":"2024-04-14T11:08:13.734714+0000","last_fullsized":"2024-04-14T11:08:13.734714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1196,"log_dups_size":0,"ondisk_log_size":1196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:50:54.276293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043860390000000004,"stat_sum":{"num_bytes":36652792,"num_objects":443,"num_object_clones":198,"num_object_copies":886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":443,"num_whiteouts":198,"num_read":1211,"num_read_kb":26111,"num_write":979,"num_write_kb":43955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"37'1225","reported_seq":3111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.758576+0000","last_change":"2024-04-14T11:01:46.059227+0000","last_active":"2024-04-14T11:08:13.758576+0000","last_peered":"2024-04-14T11:08:13.758576+0000","last_clean":"2024-04-14T11:08:13.758576+0000","last_became_active":"2024-04-14T10:58:04.212292+0000","last_became_peered":"2024-04-14T10:58:04.212292+0000","last_unstale":"2024-04-14T11:08:13.758576+0000","last_undegraded":"2024-04-14T11:08:13.758576+0000","last_fullsized":"2024-04-14T11:08:13.758576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:52:38.581076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033157820000000002,"stat_sum":{"num_bytes":3077638,"num_objects":457,"num_object_clones":212,"num_object_copies":914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":457,"num_whiteouts":212,"num_read":22,"num_read_kb":4117,"num_write":991,"num_write_kb":13165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"37'1102","reported_seq":3902,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.724786+0000","last_change":"2024-04-14T11:01:46.447958+0000","last_active":"2024-04-14T11:08:12.724786+0000","last_peered":"2024-04-14T11:08:12.724786+0000","last_clean":"2024-04-14T11:08:12.724786+0000","last_became_active":"2024-04-14T10:58:04.203668+0000","last_became_peered":"2024-04-14T10:58:04.203668+0000","last_unstale":"2024-04-14T11:08:12.724786+0000","last_undegraded":"2024-04-14T11:08:12.724786+0000","last_fullsized":"2024-04-14T11:08:12.724786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:37:00.394998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081958499999999995,"stat_sum":{"num_bytes":20358547,"num_objects":423,"num_object_clones":196,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":423,"num_whiteouts":196,"num_read":920,"num_read_kb":14330,"num_write":886,"num_write_kb":21359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"37'1201","reported_seq":4405,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.823694+0000","last_change":"2024-04-14T11:01:46.136829+0000","last_active":"2024-04-14T11:08:12.823694+0000","last_peered":"2024-04-14T11:08:12.823694+0000","last_clean":"2024-04-14T11:08:12.823694+0000","last_became_active":"2024-04-14T10:58:04.212417+0000","last_became_peered":"2024-04-14T10:58:04.212417+0000","last_unstale":"2024-04-14T11:08:12.823694+0000","last_undegraded":"2024-04-14T11:08:12.823694+0000","last_fullsized":"2024-04-14T11:08:12.823694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:32.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026237190000000001,"stat_sum":{"num_bytes":29208886,"num_objects":459,"num_object_clones":206,"num_object_copies":918,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":459,"num_whiteouts":206,"num_read":1334,"num_read_kb":31169,"num_write":977,"num_write_kb":34923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"37'1181","reported_seq":3114,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.732879+0000","last_change":"2024-04-14T11:01:46.321955+0000","last_active":"2024-04-14T11:08:13.732879+0000","last_peered":"2024-04-14T11:08:13.732879+0000","last_clean":"2024-04-14T11:08:13.732879+0000","last_became_active":"2024-04-14T10:58:44.523695+0000","last_became_peered":"2024-04-14T10:58:44.523695+0000","last_unstale":"2024-04-14T11:08:13.732879+0000","last_undegraded":"2024-04-14T11:08:13.732879+0000","last_fullsized":"2024-04-14T11:08:13.732879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:16.820507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023230210000000002,"stat_sum":{"num_bytes":7847556,"num_objects":445,"num_object_clones":206,"num_object_copies":890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":206,"num_read":58,"num_read_kb":8212,"num_write":943,"num_write_kb":18277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"37'1113","reported_seq":3032,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.761141+0000","last_change":"2024-04-14T11:01:46.215236+0000","last_active":"2024-04-14T11:08:12.761141+0000","last_peered":"2024-04-14T11:08:12.761141+0000","last_clean":"2024-04-14T11:08:12.761141+0000","last_became_active":"2024-04-14T10:58:04.208981+0000","last_became_peered":"2024-04-14T10:58:04.208981+0000","last_unstale":"2024-04-14T11:08:12.761141+0000","last_undegraded":"2024-04-14T11:08:12.761141+0000","last_fullsized":"2024-04-14T11:08:12.761141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:54:19.283814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002000941,"stat_sum":{"num_bytes":7901151,"num_objects":408,"num_object_clones":180,"num_object_copies":816,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":408,"num_whiteouts":180,"num_read":23,"num_read_kb":23,"num_write":922,"num_write_kb":10575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1240","reported_seq":3188,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.754392+0000","last_change":"2024-04-14T11:01:46.058960+0000","last_active":"2024-04-14T11:08:13.754392+0000","last_peered":"2024-04-14T11:08:13.754392+0000","last_clean":"2024-04-14T11:08:13.754392+0000","last_became_active":"2024-04-14T10:58:04.208135+0000","last_became_peered":"2024-04-14T10:58:04.208135+0000","last_unstale":"2024-04-14T11:08:13.754392+0000","last_undegraded":"2024-04-14T11:08:13.754392+0000","last_fullsized":"2024-04-14T11:08:13.754392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1240,"log_dups_size":0,"ondisk_log_size":1240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:58:01.009987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00347453,"stat_sum":{"num_bytes":13082404,"num_objects":473,"num_object_clones":218,"num_object_copies":946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":473,"num_whiteouts":218,"num_read":90,"num_read_kb":4369,"num_write":1003,"num_write_kb":22808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"37'1137","reported_seq":3455,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.780482+0000","last_change":"2024-04-14T11:01:46.639321+0000","last_active":"2024-04-14T11:08:12.780482+0000","last_peered":"2024-04-14T11:08:12.780482+0000","last_clean":"2024-04-14T11:08:12.780482+0000","last_became_active":"2024-04-14T10:58:04.211088+0000","last_became_peered":"2024-04-14T10:58:04.211088+0000","last_unstale":"2024-04-14T11:08:12.780482+0000","last_undegraded":"2024-04-14T11:08:12.780482+0000","last_fullsized":"2024-04-14T11:08:12.780482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1137,"log_dups_size":0,"ondisk_log_size":1137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:40:46.860355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002505527,"stat_sum":{"num_bytes":16463473,"num_objects":426,"num_object_clones":196,"num_object_copies":852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":426,"num_whiteouts":196,"num_read":438,"num_read_kb":16566,"num_write":924,"num_write_kb":23014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"37'1182","reported_seq":3253,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.764548+0000","last_change":"2024-04-14T11:01:46.058615+0000","last_active":"2024-04-14T11:08:12.764548+0000","last_peered":"2024-04-14T11:08:12.764548+0000","last_clean":"2024-04-14T11:08:12.764548+0000","last_became_active":"2024-04-14T10:58:04.200237+0000","last_became_peered":"2024-04-14T10:58:04.200237+0000","last_unstale":"2024-04-14T11:08:12.764548+0000","last_undegraded":"2024-04-14T11:08:12.764548+0000","last_fullsized":"2024-04-14T11:08:12.764548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:32.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044135839999999999,"stat_sum":{"num_bytes":8342677,"num_objects":432,"num_object_clones":203,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":432,"num_whiteouts":203,"num_read":198,"num_read_kb":3608,"num_write":956,"num_write_kb":11411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"37'1114","reported_seq":4034,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.939033+0000","last_change":"2024-04-14T11:01:46.639583+0000","last_active":"2024-04-14T11:08:11.939033+0000","last_peered":"2024-04-14T11:08:11.939033+0000","last_clean":"2024-04-14T11:08:11.939033+0000","last_became_active":"2024-04-14T10:58:04.211104+0000","last_became_peered":"2024-04-14T10:58:04.211104+0000","last_unstale":"2024-04-14T11:08:11.939033+0000","last_undegraded":"2024-04-14T11:08:11.939033+0000","last_fullsized":"2024-04-14T11:08:11.939033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:48:12.252007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024445550000000002,"stat_sum":{"num_bytes":24724692,"num_objects":413,"num_object_clones":190,"num_object_copies":826,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":413,"num_whiteouts":190,"num_read":1034,"num_read_kb":19259,"num_write":891,"num_write_kb":26377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"37'1202","reported_seq":3180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.740992+0000","last_change":"2024-04-14T11:01:46.322213+0000","last_active":"2024-04-14T11:08:13.740992+0000","last_peered":"2024-04-14T11:08:13.740992+0000","last_clean":"2024-04-14T11:08:13.740992+0000","last_became_active":"2024-04-14T10:58:04.209040+0000","last_became_peered":"2024-04-14T10:58:04.209040+0000","last_unstale":"2024-04-14T11:08:13.740992+0000","last_undegraded":"2024-04-14T11:08:13.740992+0000","last_fullsized":"2024-04-14T11:08:13.740992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1202,"log_dups_size":0,"ondisk_log_size":1202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:44:39.578365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024860920000000001,"stat_sum":{"num_bytes":8801026,"num_objects":422,"num_object_clones":195,"num_object_copies":844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":195,"num_read":97,"num_read_kb":1115,"num_write":982,"num_write_kb":11969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"37'1116","reported_seq":3466,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.738434+0000","last_change":"2024-04-14T11:01:46.055597+0000","last_active":"2024-04-14T11:08:13.738434+0000","last_peered":"2024-04-14T11:08:13.738434+0000","last_clean":"2024-04-14T11:08:13.738434+0000","last_became_active":"2024-04-14T10:58:04.201621+0000","last_became_peered":"2024-04-14T10:58:04.201621+0000","last_unstale":"2024-04-14T11:08:13.738434+0000","last_undegraded":"2024-04-14T11:08:13.738434+0000","last_fullsized":"2024-04-14T11:08:13.738434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1116,"log_dups_size":0,"ondisk_log_size":1116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:59:02.701374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018373879999999999,"stat_sum":{"num_bytes":20253028,"num_objects":401,"num_object_clones":181,"num_object_copies":802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":401,"num_whiteouts":181,"num_read":455,"num_read_kb":7214,"num_write":909,"num_write_kb":22504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"37'1146","reported_seq":3035,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.007958+0000","last_change":"2024-04-14T11:01:46.639339+0000","last_active":"2024-04-14T11:08:13.007958+0000","last_peered":"2024-04-14T11:08:13.007958+0000","last_clean":"2024-04-14T11:08:13.007958+0000","last_became_active":"2024-04-14T10:58:04.211858+0000","last_became_peered":"2024-04-14T10:58:04.211858+0000","last_unstale":"2024-04-14T11:08:13.007958+0000","last_undegraded":"2024-04-14T11:08:13.007958+0000","last_fullsized":"2024-04-14T11:08:13.007958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:32.032165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002336702,"stat_sum":{"num_bytes":5336640,"num_objects":435,"num_object_clones":201,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":201,"num_read":14,"num_read_kb":3287,"num_write":933,"num_write_kb":15679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"37'1256","reported_seq":3877,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.111238+0000","last_change":"2024-04-14T11:01:46.215425+0000","last_active":"2024-04-14T11:08:13.111238+0000","last_peered":"2024-04-14T11:08:13.111238+0000","last_clean":"2024-04-14T11:08:13.111238+0000","last_became_active":"2024-04-14T10:58:04.202096+0000","last_became_peered":"2024-04-14T10:58:04.202096+0000","last_unstale":"2024-04-14T11:08:13.111238+0000","last_undegraded":"2024-04-14T11:08:13.111238+0000","last_fullsized":"2024-04-14T11:08:13.111238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1256,"log_dups_size":0,"ondisk_log_size":1256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:24.791780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020856070000000002,"stat_sum":{"num_bytes":25309591,"num_objects":484,"num_object_clones":220,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":220,"num_read":765,"num_read_kb":18582,"num_write":1015,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"37'1164","reported_seq":3073,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942805+0000","last_change":"2024-04-14T11:01:46.059118+0000","last_active":"2024-04-14T11:08:15.942805+0000","last_peered":"2024-04-14T11:08:15.942805+0000","last_clean":"2024-04-14T11:08:15.942805+0000","last_became_active":"2024-04-14T10:58:04.200278+0000","last_became_peered":"2024-04-14T10:58:04.200278+0000","last_unstale":"2024-04-14T11:08:15.942805+0000","last_undegraded":"2024-04-14T11:08:15.942805+0000","last_fullsized":"2024-04-14T11:08:15.942805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1164,"log_dups_size":0,"ondisk_log_size":1164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:39.135097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033257540000000002,"stat_sum":{"num_bytes":4210817,"num_objects":410,"num_object_clones":188,"num_object_copies":820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":410,"num_whiteouts":188,"num_read":21,"num_read_kb":21,"num_write":957,"num_write_kb":6804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"37'1274","reported_seq":3636,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.943590+0000","last_change":"2024-04-14T11:01:46.448116+0000","last_active":"2024-04-14T11:08:12.943590+0000","last_peered":"2024-04-14T11:08:12.943590+0000","last_clean":"2024-04-14T11:08:12.943590+0000","last_became_active":"2024-04-14T10:58:04.210912+0000","last_became_peered":"2024-04-14T10:58:04.210912+0000","last_unstale":"2024-04-14T11:08:12.943590+0000","last_undegraded":"2024-04-14T11:08:12.943590+0000","last_fullsized":"2024-04-14T11:08:12.943590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1274,"log_dups_size":0,"ondisk_log_size":1274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:31.582916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095383700000000002,"stat_sum":{"num_bytes":25225684,"num_objects":451,"num_object_clones":202,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":202,"num_read":488,"num_read_kb":13946,"num_write":1039,"num_write_kb":32820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"37'1189","reported_seq":4009,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.732840+0000","last_change":"2024-04-14T11:01:46.321289+0000","last_active":"2024-04-14T11:08:13.732840+0000","last_peered":"2024-04-14T11:08:13.732840+0000","last_clean":"2024-04-14T11:08:13.732840+0000","last_became_active":"2024-04-14T10:58:04.202004+0000","last_became_peered":"2024-04-14T10:58:04.202004+0000","last_unstale":"2024-04-14T11:08:13.732840+0000","last_undegraded":"2024-04-14T11:08:13.732840+0000","last_fullsized":"2024-04-14T11:08:13.732840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1189,"log_dups_size":0,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:29.137694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020356409999999999,"stat_sum":{"num_bytes":24681299,"num_objects":420,"num_object_clones":191,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":420,"num_whiteouts":191,"num_read":935,"num_read_kb":14211,"num_write":974,"num_write_kb":26175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"37'1194","reported_seq":4261,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.747966+0000","last_change":"2024-04-14T11:01:46.055881+0000","last_active":"2024-04-14T11:08:12.747966+0000","last_peered":"2024-04-14T11:08:12.747966+0000","last_clean":"2024-04-14T11:08:12.747966+0000","last_became_active":"2024-04-14T10:58:04.203554+0000","last_became_peered":"2024-04-14T10:58:04.203554+0000","last_unstale":"2024-04-14T11:08:12.747966+0000","last_undegraded":"2024-04-14T11:08:12.747966+0000","last_fullsized":"2024-04-14T11:08:12.747966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:14:37.096949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001688852,"stat_sum":{"num_bytes":28527487,"num_objects":450,"num_object_clones":201,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":450,"num_whiteouts":201,"num_read":1192,"num_read_kb":20708,"num_write":976,"num_write_kb":30793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"37'278","reported_seq":330,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942293+0000","last_change":"2024-04-14T10:58:03.199988+0000","last_active":"2024-04-14T11:08:15.942293+0000","last_peered":"2024-04-14T11:08:15.942293+0000","last_clean":"2024-04-14T11:08:15.942293+0000","last_became_active":"2024-04-14T10:58:03.199706+0000","last_became_peered":"2024-04-14T10:58:03.199706+0000","last_unstale":"2024-04-14T11:08:15.942293+0000","last_undegraded":"2024-04-14T11:08:15.942293+0000","last_fullsized":"2024-04-14T11:08:15.942293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46138407,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":316,"num_write_kb":62411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"37'1162","reported_seq":3858,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.735686+0000","last_change":"2024-04-14T11:01:46.215484+0000","last_active":"2024-04-14T11:08:13.735686+0000","last_peered":"2024-04-14T11:08:13.735686+0000","last_clean":"2024-04-14T11:08:13.735686+0000","last_became_active":"2024-04-14T10:58:04.199990+0000","last_became_peered":"2024-04-14T10:58:04.199990+0000","last_unstale":"2024-04-14T11:08:13.735686+0000","last_undegraded":"2024-04-14T11:08:13.735686+0000","last_fullsized":"2024-04-14T11:08:13.735686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1162,"log_dups_size":0,"ondisk_log_size":1162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:48:05.190616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001900709,"stat_sum":{"num_bytes":17815406,"num_objects":463,"num_object_clones":215,"num_object_copies":926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":463,"num_whiteouts":215,"num_read":835,"num_read_kb":8673,"num_write":923,"num_write_kb":19950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"37'564","reported_seq":616,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.784523+0000","last_change":"2024-04-14T10:58:03.194054+0000","last_active":"2024-04-14T11:08:11.784523+0000","last_peered":"2024-04-14T11:08:11.784523+0000","last_clean":"2024-04-14T11:08:11.784523+0000","last_became_active":"2024-04-14T10:58:03.193740+0000","last_became_peered":"2024-04-14T10:58:03.193740+0000","last_unstale":"2024-04-14T11:08:11.784523+0000","last_undegraded":"2024-04-14T11:08:11.784523+0000","last_fullsized":"2024-04-14T11:08:11.784523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":564,"log_dups_size":0,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":576,"num_write_kb":62409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"37'365","reported_seq":417,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.815562+0000","last_change":"2024-04-14T10:58:03.195251+0000","last_active":"2024-04-14T11:08:15.815562+0000","last_peered":"2024-04-14T11:08:15.815562+0000","last_clean":"2024-04-14T11:08:15.815562+0000","last_became_active":"2024-04-14T10:58:03.194558+0000","last_became_peered":"2024-04-14T10:58:03.194558+0000","last_unstale":"2024-04-14T11:08:15.815562+0000","last_undegraded":"2024-04-14T11:08:15.815562+0000","last_fullsized":"2024-04-14T11:08:15.815562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":388,"num_write_kb":33534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'1323","reported_seq":4015,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.942807+0000","last_change":"2024-04-14T11:01:46.641098+0000","last_active":"2024-04-14T11:08:11.942807+0000","last_peered":"2024-04-14T11:08:11.942807+0000","last_clean":"2024-04-14T11:08:11.942807+0000","last_became_active":"2024-04-14T10:58:04.206838+0000","last_became_peered":"2024-04-14T10:58:04.206838+0000","last_unstale":"2024-04-14T11:08:11.942807+0000","last_undegraded":"2024-04-14T11:08:11.942807+0000","last_fullsized":"2024-04-14T11:08:11.942807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1323,"log_dups_size":0,"ondisk_log_size":1323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:50:54.276293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036777989999999998,"stat_sum":{"num_bytes":29819340,"num_objects":499,"num_object_clones":226,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":226,"num_read":842,"num_read_kb":23290,"num_write":1071,"num_write_kb":43999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"37'609","reported_seq":661,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.689623+0000","last_change":"2024-04-14T10:58:03.196357+0000","last_active":"2024-04-14T11:08:11.689623+0000","last_peered":"2024-04-14T11:08:11.689623+0000","last_clean":"2024-04-14T11:08:11.689623+0000","last_became_active":"2024-04-14T10:58:03.196104+0000","last_became_peered":"2024-04-14T10:58:03.196104+0000","last_unstale":"2024-04-14T11:08:11.689623+0000","last_undegraded":"2024-04-14T11:08:11.689623+0000","last_fullsized":"2024-04-14T11:08:11.689623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":609,"num_write_kb":58510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"37'1129","reported_seq":3711,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.717108+0000","last_change":"2024-04-14T11:01:46.054880+0000","last_active":"2024-04-14T11:08:13.717108+0000","last_peered":"2024-04-14T11:08:13.717108+0000","last_clean":"2024-04-14T11:08:13.717108+0000","last_became_active":"2024-04-14T10:58:04.207977+0000","last_became_peered":"2024-04-14T10:58:04.207977+0000","last_unstale":"2024-04-14T11:08:13.717108+0000","last_undegraded":"2024-04-14T11:08:13.717108+0000","last_fullsized":"2024-04-14T11:08:13.717108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1129,"log_dups_size":0,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:29.137694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001465095,"stat_sum":{"num_bytes":24816056,"num_objects":418,"num_object_clones":193,"num_object_copies":836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":418,"num_whiteouts":193,"num_read":699,"num_read_kb":19897,"num_write":908,"num_write_kb":30439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"37'233","reported_seq":285,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374600+0000","last_change":"2024-04-14T10:58:03.196192+0000","last_active":"2024-04-14T11:08:14.374600+0000","last_peered":"2024-04-14T11:08:14.374600+0000","last_clean":"2024-04-14T11:08:14.374600+0000","last_became_active":"2024-04-14T10:58:03.195872+0000","last_became_peered":"2024-04-14T10:58:03.195872+0000","last_unstale":"2024-04-14T11:08:14.374600+0000","last_undegraded":"2024-04-14T11:08:14.374600+0000","last_fullsized":"2024-04-14T11:08:14.374600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971610,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":254,"num_write_kb":41665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"37'1146","reported_seq":3057,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.904056+0000","last_change":"2024-04-14T11:01:46.059470+0000","last_active":"2024-04-14T11:08:12.904056+0000","last_peered":"2024-04-14T11:08:12.904056+0000","last_clean":"2024-04-14T11:08:12.904056+0000","last_became_active":"2024-04-14T10:58:04.207871+0000","last_became_peered":"2024-04-14T10:58:04.207871+0000","last_unstale":"2024-04-14T11:08:12.904056+0000","last_undegraded":"2024-04-14T11:08:12.904056+0000","last_fullsized":"2024-04-14T11:08:12.904056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:37.542711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033562430000000001,"stat_sum":{"num_bytes":8421268,"num_objects":406,"num_object_clones":185,"num_object_copies":812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":406,"num_whiteouts":185,"num_read":20,"num_read_kb":20,"num_write":928,"num_write_kb":10136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"37'663","reported_seq":715,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.783494+0000","last_change":"2024-04-14T10:58:03.195751+0000","last_active":"2024-04-14T11:08:11.783494+0000","last_peered":"2024-04-14T11:08:11.783494+0000","last_clean":"2024-04-14T11:08:11.783494+0000","last_became_active":"2024-04-14T10:58:03.194988+0000","last_became_peered":"2024-04-14T10:58:03.194988+0000","last_unstale":"2024-04-14T11:08:11.783494+0000","last_undegraded":"2024-04-14T11:08:11.783494+0000","last_fullsized":"2024-04-14T11:08:11.783494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":671,"num_write_kb":41797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"37'1301","reported_seq":3543,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.719935+0000","last_change":"2024-04-14T11:01:46.214142+0000","last_active":"2024-04-14T11:08:13.719935+0000","last_peered":"2024-04-14T11:08:13.719935+0000","last_clean":"2024-04-14T11:08:13.719935+0000","last_became_active":"2024-04-14T10:58:04.200618+0000","last_became_peered":"2024-04-14T10:58:04.200618+0000","last_unstale":"2024-04-14T11:08:13.719935+0000","last_undegraded":"2024-04-14T11:08:13.719935+0000","last_fullsized":"2024-04-14T11:08:13.719935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1301,"log_dups_size":0,"ondisk_log_size":1301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:08.021592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001340567,"stat_sum":{"num_bytes":16518466,"num_objects":530,"num_object_clones":280,"num_object_copies":1060,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":530,"num_whiteouts":217,"num_read":446,"num_read_kb":12307,"num_write":999,"num_write_kb":17921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"37'885","reported_seq":937,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.567216+0000","last_change":"2024-04-14T10:58:03.197508+0000","last_active":"2024-04-14T11:08:13.567216+0000","last_peered":"2024-04-14T11:08:13.567216+0000","last_clean":"2024-04-14T11:08:13.567216+0000","last_became_active":"2024-04-14T10:58:03.196764+0000","last_became_peered":"2024-04-14T10:58:03.196764+0000","last_unstale":"2024-04-14T11:08:13.567216+0000","last_undegraded":"2024-04-14T11:08:13.567216+0000","last_fullsized":"2024-04-14T11:08:13.567216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":895,"num_write_kb":34181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'1167","reported_seq":3630,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.747601+0000","last_change":"2024-04-14T11:01:46.057047+0000","last_active":"2024-04-14T11:08:13.747601+0000","last_peered":"2024-04-14T11:08:13.747601+0000","last_clean":"2024-04-14T11:08:13.747601+0000","last_became_active":"2024-04-14T10:58:04.205867+0000","last_became_peered":"2024-04-14T10:58:04.205867+0000","last_unstale":"2024-04-14T11:08:13.747601+0000","last_undegraded":"2024-04-14T11:08:13.747601+0000","last_fullsized":"2024-04-14T11:08:13.747601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1167,"log_dups_size":0,"ondisk_log_size":1167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:37:50.214998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654339999999999,"stat_sum":{"num_bytes":16000036,"num_objects":435,"num_object_clones":201,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":201,"num_read":588,"num_read_kb":13378,"num_write":954,"num_write_kb":22105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"37'646","reported_seq":698,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374304+0000","last_change":"2024-04-14T10:58:03.195426+0000","last_active":"2024-04-14T11:08:14.374304+0000","last_peered":"2024-04-14T11:08:14.374304+0000","last_clean":"2024-04-14T11:08:14.374304+0000","last_became_active":"2024-04-14T10:58:03.195190+0000","last_became_peered":"2024-04-14T10:58:03.195190+0000","last_unstale":"2024-04-14T11:08:14.374304+0000","last_undegraded":"2024-04-14T11:08:14.374304+0000","last_fullsized":"2024-04-14T11:08:14.374304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360800,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":659,"num_write_kb":58272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"37'1153","reported_seq":3642,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.082605+0000","last_change":"2024-04-14T11:01:46.135734+0000","last_active":"2024-04-14T11:08:13.082605+0000","last_peered":"2024-04-14T11:08:13.082605+0000","last_clean":"2024-04-14T11:08:13.082605+0000","last_became_active":"2024-04-14T10:58:04.210999+0000","last_became_peered":"2024-04-14T10:58:04.210999+0000","last_unstale":"2024-04-14T11:08:13.082605+0000","last_undegraded":"2024-04-14T11:08:13.082605+0000","last_fullsized":"2024-04-14T11:08:13.082605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1153,"log_dups_size":0,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:30:29.229892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001966289,"stat_sum":{"num_bytes":16772347,"num_objects":436,"num_object_clones":202,"num_object_copies":872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":436,"num_whiteouts":202,"num_read":615,"num_read_kb":13306,"num_write":921,"num_write_kb":18622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"37'846","reported_seq":898,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374307+0000","last_change":"2024-04-14T10:58:03.192839+0000","last_active":"2024-04-14T11:08:14.374307+0000","last_peered":"2024-04-14T11:08:14.374307+0000","last_clean":"2024-04-14T11:08:14.374307+0000","last_became_active":"2024-04-14T10:58:03.192555+0000","last_became_peered":"2024-04-14T10:58:03.192555+0000","last_unstale":"2024-04-14T11:08:14.374307+0000","last_undegraded":"2024-04-14T11:08:14.374307+0000","last_fullsized":"2024-04-14T11:08:14.374307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":878,"num_write_kb":33957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"37'1286","reported_seq":3549,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.758806+0000","last_change":"2024-04-14T11:01:46.214983+0000","last_active":"2024-04-14T11:08:12.758806+0000","last_peered":"2024-04-14T11:08:12.758806+0000","last_clean":"2024-04-14T11:08:12.758806+0000","last_became_active":"2024-04-14T10:58:04.204652+0000","last_became_peered":"2024-04-14T10:58:04.204652+0000","last_unstale":"2024-04-14T11:08:12.758806+0000","last_undegraded":"2024-04-14T11:08:12.758806+0000","last_fullsized":"2024-04-14T11:08:12.758806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:46:01.579743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021176770000000001,"stat_sum":{"num_bytes":12169944,"num_objects":484,"num_object_clones":253,"num_object_copies":968,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":484,"num_whiteouts":190,"num_read":440,"num_read_kb":12791,"num_write":1009,"num_write_kb":30233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"37'169","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.614454+0000","last_change":"2024-04-14T10:58:03.195104+0000","last_active":"2024-04-14T11:08:12.614454+0000","last_peered":"2024-04-14T11:08:12.614454+0000","last_clean":"2024-04-14T11:08:12.614454+0000","last_became_active":"2024-04-14T10:58:03.194782+0000","last_became_peered":"2024-04-14T10:58:03.194782+0000","last_unstale":"2024-04-14T11:08:12.614454+0000","last_undegraded":"2024-04-14T11:08:12.614454+0000","last_fullsized":"2024-04-14T11:08:12.614454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":190,"num_write_kb":17333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"37'1208","reported_seq":3587,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.718354+0000","last_change":"2024-04-14T11:01:46.136556+0000","last_active":"2024-04-14T11:08:13.718354+0000","last_peered":"2024-04-14T11:08:13.718354+0000","last_clean":"2024-04-14T11:08:13.718354+0000","last_became_active":"2024-04-14T10:58:04.211293+0000","last_became_peered":"2024-04-14T10:58:04.211293+0000","last_unstale":"2024-04-14T11:08:13.718354+0000","last_undegraded":"2024-04-14T11:08:13.718354+0000","last_fullsized":"2024-04-14T11:08:13.718354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1208,"log_dups_size":0,"ondisk_log_size":1208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:50:54.276293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025159980000000002,"stat_sum":{"num_bytes":11616132,"num_objects":445,"num_object_clones":207,"num_object_copies":890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":445,"num_whiteouts":207,"num_read":510,"num_read_kb":8723,"num_write":976,"num_write_kb":14293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"37'206","reported_seq":258,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.627554+0000","last_change":"2024-04-14T10:58:03.190816+0000","last_active":"2024-04-14T11:08:12.627554+0000","last_peered":"2024-04-14T11:08:12.627554+0000","last_clean":"2024-04-14T11:08:12.627554+0000","last_became_active":"2024-04-14T10:58:03.190564+0000","last_became_peered":"2024-04-14T10:58:03.190564+0000","last_unstale":"2024-04-14T11:08:12.627554+0000","last_undegraded":"2024-04-14T11:08:12.627554+0000","last_fullsized":"2024-04-14T11:08:12.627554+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16778245,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":195,"num_write_kb":25208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"37'1134","reported_seq":3105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.738572+0000","last_change":"2024-04-14T11:01:46.320938+0000","last_active":"2024-04-14T11:08:13.738572+0000","last_peered":"2024-04-14T11:08:13.738572+0000","last_clean":"2024-04-14T11:08:13.738572+0000","last_became_active":"2024-04-14T10:58:04.201610+0000","last_became_peered":"2024-04-14T10:58:04.201610+0000","last_unstale":"2024-04-14T11:08:13.738572+0000","last_undegraded":"2024-04-14T11:08:13.738572+0000","last_fullsized":"2024-04-14T11:08:13.738572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:53:07.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018262560000000001,"stat_sum":{"num_bytes":12846031,"num_objects":411,"num_object_clones":191,"num_object_copies":822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":411,"num_whiteouts":191,"num_read":87,"num_read_kb":1698,"num_write":907,"num_write_kb":14257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"37'434","reported_seq":486,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.804830+0000","last_change":"2024-04-14T10:58:03.188624+0000","last_active":"2024-04-14T11:08:15.804830+0000","last_peered":"2024-04-14T11:08:15.804830+0000","last_clean":"2024-04-14T11:08:15.804830+0000","last_became_active":"2024-04-14T10:58:03.188340+0000","last_became_peered":"2024-04-14T10:58:03.188340+0000","last_unstale":"2024-04-14T11:08:15.804830+0000","last_undegraded":"2024-04-14T11:08:15.804830+0000","last_fullsized":"2024-04-14T11:08:15.804830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:05.182578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":469,"num_write_kb":25485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"37'1209","reported_seq":3399,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.749310+0000","last_change":"2024-04-14T11:01:46.136117+0000","last_active":"2024-04-14T11:08:13.749310+0000","last_peered":"2024-04-14T11:08:13.749310+0000","last_clean":"2024-04-14T11:08:13.749310+0000","last_became_active":"2024-04-14T10:58:04.212747+0000","last_became_peered":"2024-04-14T10:58:04.212747+0000","last_unstale":"2024-04-14T11:08:13.749310+0000","last_undegraded":"2024-04-14T11:08:13.749310+0000","last_fullsized":"2024-04-14T11:08:13.749310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:48:12.252007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023378259999999999,"stat_sum":{"num_bytes":12972619,"num_objects":434,"num_object_clones":201,"num_object_copies":868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":434,"num_whiteouts":201,"num_read":315,"num_read_kb":12293,"num_write":980,"num_write_kb":23633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"37'222","reported_seq":274,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.366125+0000","last_change":"2024-04-14T10:58:03.192735+0000","last_active":"2024-04-14T11:08:14.366125+0000","last_peered":"2024-04-14T11:08:14.366125+0000","last_clean":"2024-04-14T11:08:14.366125+0000","last_became_active":"2024-04-14T10:58:03.192443+0000","last_became_peered":"2024-04-14T10:58:03.192443+0000","last_unstale":"2024-04-14T11:08:14.366125+0000","last_undegraded":"2024-04-14T11:08:14.366125+0000","last_fullsized":"2024-04-14T11:08:14.366125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:06.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971542,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":223,"num_write_kb":33553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"37'1152","reported_seq":3243,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.761527+0000","last_change":"2024-04-14T11:01:46.136842+0000","last_active":"2024-04-14T11:08:13.761527+0000","last_peered":"2024-04-14T11:08:13.761527+0000","last_clean":"2024-04-14T11:08:13.761527+0000","last_became_active":"2024-04-14T10:58:04.211677+0000","last_became_peered":"2024-04-14T10:58:04.211677+0000","last_unstale":"2024-04-14T11:08:13.761527+0000","last_undegraded":"2024-04-14T11:08:13.761527+0000","last_fullsized":"2024-04-14T11:08:13.761527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1152,"log_dups_size":0,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:47:30.020829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024830059999999998,"stat_sum":{"num_bytes":12538479,"num_objects":444,"num_object_clones":204,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":444,"num_whiteouts":204,"num_read":219,"num_read_kb":8478,"num_write":922,"num_write_kb":19471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"37'348","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.967737+0000","last_change":"2024-04-14T10:58:03.192466+0000","last_active":"2024-04-14T11:08:11.967737+0000","last_peered":"2024-04-14T11:08:11.967737+0000","last_clean":"2024-04-14T11:08:11.967737+0000","last_became_active":"2024-04-14T10:58:03.191371+0000","last_became_peered":"2024-04-14T10:58:03.191371+0000","last_unstale":"2024-04-14T11:08:11.967737+0000","last_undegraded":"2024-04-14T11:08:11.967737+0000","last_fullsized":"2024-04-14T11:08:11.967737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":355,"num_write_kb":49989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"37'1146","reported_seq":3378,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.734993+0000","last_change":"2024-04-14T11:01:46.137451+0000","last_active":"2024-04-14T11:08:12.734993+0000","last_peered":"2024-04-14T11:08:12.734993+0000","last_clean":"2024-04-14T11:08:12.734993+0000","last_became_active":"2024-04-14T10:58:04.211983+0000","last_became_peered":"2024-04-14T10:58:04.211983+0000","last_unstale":"2024-04-14T11:08:12.734993+0000","last_undegraded":"2024-04-14T11:08:12.734993+0000","last_fullsized":"2024-04-14T11:08:12.734993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1146,"log_dups_size":0,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:58:01.009987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026442639999999999,"stat_sum":{"num_bytes":12130040,"num_objects":419,"num_object_clones":192,"num_object_copies":838,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":419,"num_whiteouts":192,"num_read":348,"num_read_kb":12451,"num_write":933,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"37'318","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.755682+0000","last_change":"2024-04-14T10:58:03.196416+0000","last_active":"2024-04-14T11:08:15.755682+0000","last_peered":"2024-04-14T11:08:15.755682+0000","last_clean":"2024-04-14T11:08:15.755682+0000","last_became_active":"2024-04-14T10:58:03.196090+0000","last_became_peered":"2024-04-14T10:58:03.196090+0000","last_unstale":"2024-04-14T11:08:15.755682+0000","last_undegraded":"2024-04-14T11:08:15.755682+0000","last_fullsized":"2024-04-14T11:08:15.755682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12585503,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":318,"num_write_kb":45809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"37'1177","reported_seq":3081,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.736703+0000","last_change":"2024-04-14T11:01:46.059719+0000","last_active":"2024-04-14T11:08:13.736703+0000","last_peered":"2024-04-14T11:08:13.736703+0000","last_clean":"2024-04-14T11:08:13.736703+0000","last_became_active":"2024-04-14T10:58:04.201191+0000","last_became_peered":"2024-04-14T10:58:04.201191+0000","last_unstale":"2024-04-14T11:08:13.736703+0000","last_undegraded":"2024-04-14T11:08:13.736703+0000","last_fullsized":"2024-04-14T11:08:13.736703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1177,"log_dups_size":0,"ondisk_log_size":1177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:53:19.962222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032669050000000001,"stat_sum":{"num_bytes":4362818,"num_objects":402,"num_object_clones":186,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":186,"num_read":14,"num_read_kb":14,"num_write":968,"num_write_kb":7521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"37'269","reported_seq":321,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.566674+0000","last_change":"2024-04-14T10:58:03.191525+0000","last_active":"2024-04-14T11:08:13.566674+0000","last_peered":"2024-04-14T11:08:13.566674+0000","last_clean":"2024-04-14T11:08:13.566674+0000","last_became_active":"2024-04-14T10:58:03.191210+0000","last_became_peered":"2024-04-14T10:58:03.191210+0000","last_unstale":"2024-04-14T11:08:13.566674+0000","last_undegraded":"2024-04-14T11:08:13.566674+0000","last_fullsized":"2024-04-14T11:08:13.566674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":279,"num_write_kb":41655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'1140","reported_seq":3935,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.717901+0000","last_change":"2024-04-14T11:01:46.136277+0000","last_active":"2024-04-14T11:08:13.717901+0000","last_peered":"2024-04-14T11:08:13.717901+0000","last_clean":"2024-04-14T11:08:13.717901+0000","last_became_active":"2024-04-14T10:58:44.520085+0000","last_became_peered":"2024-04-14T10:58:44.520085+0000","last_unstale":"2024-04-14T11:08:13.717901+0000","last_undegraded":"2024-04-14T11:08:13.717901+0000","last_fullsized":"2024-04-14T11:08:13.717901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:39:13.715767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022934119999999999,"stat_sum":{"num_bytes":20633743,"num_objects":431,"num_object_clones":196,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":196,"num_read":910,"num_read_kb":15437,"num_write":927,"num_write_kb":27654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":209,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:05:56.463220+0000","last_change":"2024-04-14T10:57:52.650824+0000","last_active":"2024-04-14T11:05:56.463220+0000","last_peered":"2024-04-14T11:05:56.463220+0000","last_clean":"2024-04-14T11:05:56.463220+0000","last_became_active":"2024-04-14T10:57:52.650510+0000","last_became_peered":"2024-04-14T10:57:52.650510+0000","last_unstale":"2024-04-14T11:05:56.463220+0000","last_undegraded":"2024-04-14T11:05:56.463220+0000","last_fullsized":"2024-04-14T11:05:56.463220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:57:51.432613+0000","last_clean_scrub_stamp":"2024-04-14T10:57:51.432613+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:22.669581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"37'218","reported_seq":270,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.782056+0000","last_change":"2024-04-14T10:58:03.182776+0000","last_active":"2024-04-14T11:08:11.782056+0000","last_peered":"2024-04-14T11:08:11.782056+0000","last_clean":"2024-04-14T11:08:11.782056+0000","last_became_active":"2024-04-14T10:58:03.182491+0000","last_became_peered":"2024-04-14T10:58:03.182491+0000","last_unstale":"2024-04-14T11:08:11.782056+0000","last_undegraded":"2024-04-14T11:08:11.782056+0000","last_fullsized":"2024-04-14T11:08:11.782056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:22:18.945642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777250,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":224,"num_write_kb":33432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"37'1195","reported_seq":3356,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942349+0000","last_change":"2024-04-14T11:01:46.640781+0000","last_active":"2024-04-14T11:08:15.942349+0000","last_peered":"2024-04-14T11:08:15.942349+0000","last_clean":"2024-04-14T11:08:15.942349+0000","last_became_active":"2024-04-14T10:58:04.205342+0000","last_became_peered":"2024-04-14T10:58:04.205342+0000","last_unstale":"2024-04-14T11:08:15.942349+0000","last_undegraded":"2024-04-14T11:08:15.942349+0000","last_fullsized":"2024-04-14T11:08:15.942349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1195,"log_dups_size":0,"ondisk_log_size":1195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:18.646219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00346307,"stat_sum":{"num_bytes":8355389,"num_objects":467,"num_object_clones":217,"num_object_copies":934,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":467,"num_whiteouts":217,"num_read":302,"num_read_kb":5669,"num_write":959,"num_write_kb":14511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"37'243","reported_seq":296,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.785051+0000","last_change":"2024-04-14T10:58:03.198402+0000","last_active":"2024-04-14T11:08:11.785051+0000","last_peered":"2024-04-14T11:08:11.785051+0000","last_clean":"2024-04-14T11:08:11.785051+0000","last_became_active":"2024-04-14T10:58:03.198048+0000","last_became_peered":"2024-04-14T10:58:03.198048+0000","last_unstale":"2024-04-14T11:08:11.785051+0000","last_undegraded":"2024-04-14T11:08:11.785051+0000","last_fullsized":"2024-04-14T11:08:11.785051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":258,"num_write_kb":50068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"37'1086","reported_seq":3186,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.720588+0000","last_change":"2024-04-14T11:01:46.215203+0000","last_active":"2024-04-14T11:08:12.720588+0000","last_peered":"2024-04-14T11:08:12.720588+0000","last_clean":"2024-04-14T11:08:12.720588+0000","last_became_active":"2024-04-14T10:58:04.196650+0000","last_became_peered":"2024-04-14T10:58:04.196650+0000","last_unstale":"2024-04-14T11:08:12.720588+0000","last_undegraded":"2024-04-14T11:08:12.720588+0000","last_fullsized":"2024-04-14T11:08:12.720588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:22:25.221955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022432480000000002,"stat_sum":{"num_bytes":15941659,"num_objects":393,"num_object_clones":182,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":393,"num_whiteouts":182,"num_read":206,"num_read_kb":4126,"num_write":879,"num_write_kb":18711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"37'768","reported_seq":1348,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.712753+0000","last_change":"2024-04-14T10:58:03.186702+0000","last_active":"2024-04-14T11:08:13.712753+0000","last_peered":"2024-04-14T11:08:13.712753+0000","last_clean":"2024-04-14T11:08:13.712753+0000","last_became_active":"2024-04-14T10:58:03.186360+0000","last_became_peered":"2024-04-14T10:58:03.186360+0000","last_unstale":"2024-04-14T11:08:13.712753+0000","last_undegraded":"2024-04-14T11:08:13.712753+0000","last_fullsized":"2024-04-14T11:08:13.712753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24675831,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":540,"num_read_kb":3961,"num_write":774,"num_write_kb":49873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'1173","reported_seq":3436,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.743338+0000","last_change":"2024-04-14T11:01:46.055054+0000","last_active":"2024-04-14T11:08:12.743338+0000","last_peered":"2024-04-14T11:08:12.743338+0000","last_clean":"2024-04-14T11:08:12.743338+0000","last_became_active":"2024-04-14T10:58:04.207607+0000","last_became_peered":"2024-04-14T10:58:04.207607+0000","last_unstale":"2024-04-14T11:08:12.743338+0000","last_undegraded":"2024-04-14T11:08:12.743338+0000","last_fullsized":"2024-04-14T11:08:12.743338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1173,"log_dups_size":0,"ondisk_log_size":1173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:24:18.724472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016065350000000001,"stat_sum":{"num_bytes":12135704,"num_objects":441,"num_object_clones":205,"num_object_copies":882,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":441,"num_whiteouts":205,"num_read":391,"num_read_kb":5329,"num_write":943,"num_write_kb":13900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"37'243","reported_seq":295,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.376131+0000","last_change":"2024-04-14T10:58:03.192613+0000","last_active":"2024-04-14T11:08:14.376131+0000","last_peered":"2024-04-14T11:08:14.376131+0000","last_clean":"2024-04-14T11:08:14.376131+0000","last_became_active":"2024-04-14T10:58:03.192299+0000","last_became_peered":"2024-04-14T10:58:03.192299+0000","last_unstale":"2024-04-14T11:08:14.376131+0000","last_undegraded":"2024-04-14T11:08:14.376131+0000","last_fullsized":"2024-04-14T11:08:14.376131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":254,"num_write_kb":49815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"37'1184","reported_seq":3236,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.936735+0000","last_change":"2024-04-14T11:01:46.055964+0000","last_active":"2024-04-14T11:08:12.936735+0000","last_peered":"2024-04-14T11:08:12.936735+0000","last_clean":"2024-04-14T11:08:12.936735+0000","last_became_active":"2024-04-14T10:58:04.204661+0000","last_became_peered":"2024-04-14T10:58:04.204661+0000","last_unstale":"2024-04-14T11:08:12.936735+0000","last_undegraded":"2024-04-14T11:08:12.936735+0000","last_fullsized":"2024-04-14T11:08:12.936735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1184,"log_dups_size":0,"ondisk_log_size":1184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:33:26.748215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011886729999999999,"stat_sum":{"num_bytes":12719680,"num_objects":421,"num_object_clones":196,"num_object_copies":842,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":421,"num_whiteouts":196,"num_read":172,"num_read_kb":4962,"num_write":972,"num_write_kb":15502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"37'308","reported_seq":360,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.784782+0000","last_change":"2024-04-14T10:58:03.197414+0000","last_active":"2024-04-14T11:08:11.784782+0000","last_peered":"2024-04-14T11:08:11.784782+0000","last_clean":"2024-04-14T11:08:11.784782+0000","last_became_active":"2024-04-14T10:58:03.197099+0000","last_became_peered":"2024-04-14T10:58:03.197099+0000","last_unstale":"2024-04-14T11:08:11.784782+0000","last_undegraded":"2024-04-14T11:08:11.784782+0000","last_fullsized":"2024-04-14T11:08:11.784782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":303,"num_write_kb":45716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"37'1186","reported_seq":4415,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.899364+0000","last_change":"2024-04-14T11:01:46.058738+0000","last_active":"2024-04-14T11:08:12.899364+0000","last_peered":"2024-04-14T11:08:12.899364+0000","last_clean":"2024-04-14T11:08:12.899364+0000","last_became_active":"2024-04-14T10:58:44.521016+0000","last_became_peered":"2024-04-14T10:58:44.521016+0000","last_unstale":"2024-04-14T11:08:12.899364+0000","last_undegraded":"2024-04-14T11:08:12.899364+0000","last_fullsized":"2024-04-14T11:08:12.899364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1186,"log_dups_size":0,"ondisk_log_size":1186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:47:30.020829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038959760000000002,"stat_sum":{"num_bytes":33623883,"num_objects":431,"num_object_clones":187,"num_object_copies":862,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":431,"num_whiteouts":187,"num_read":1335,"num_read_kb":21513,"num_write":969,"num_write_kb":40119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"37'257","reported_seq":309,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.566735+0000","last_change":"2024-04-14T10:58:03.198356+0000","last_active":"2024-04-14T11:08:13.566735+0000","last_peered":"2024-04-14T11:08:13.566735+0000","last_clean":"2024-04-14T11:08:13.566735+0000","last_became_active":"2024-04-14T10:58:03.197888+0000","last_became_peered":"2024-04-14T10:58:03.197888+0000","last_unstale":"2024-04-14T11:08:13.566735+0000","last_undegraded":"2024-04-14T11:08:13.566735+0000","last_fullsized":"2024-04-14T11:08:13.566735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:48.791783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":270,"num_write_kb":37694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"37'1166","reported_seq":3425,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.728936+0000","last_change":"2024-04-14T11:01:46.055103+0000","last_active":"2024-04-14T11:08:13.728936+0000","last_peered":"2024-04-14T11:08:13.728936+0000","last_clean":"2024-04-14T11:08:13.728936+0000","last_became_active":"2024-04-14T10:58:04.202630+0000","last_became_peered":"2024-04-14T10:58:04.202630+0000","last_unstale":"2024-04-14T11:08:13.728936+0000","last_undegraded":"2024-04-14T11:08:13.728936+0000","last_fullsized":"2024-04-14T11:08:13.728936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1166,"log_dups_size":0,"ondisk_log_size":1166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:29:12.622348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016395820000000001,"stat_sum":{"num_bytes":20085455,"num_objects":430,"num_object_clones":197,"num_object_copies":860,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":430,"num_whiteouts":197,"num_read":380,"num_read_kb":6909,"num_write":950,"num_write_kb":21700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"37'511","reported_seq":563,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.808781+0000","last_change":"2024-04-14T10:58:03.195468+0000","last_active":"2024-04-14T11:08:15.808781+0000","last_peered":"2024-04-14T11:08:15.808781+0000","last_clean":"2024-04-14T11:08:15.808781+0000","last_became_active":"2024-04-14T10:58:03.195187+0000","last_became_peered":"2024-04-14T10:58:03.195187+0000","last_unstale":"2024-04-14T11:08:15.808781+0000","last_undegraded":"2024-04-14T11:08:15.808781+0000","last_fullsized":"2024-04-14T11:08:15.808781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:17:56.269185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":1069,"num_write_kb":32651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"37'1117","reported_seq":3014,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.721329+0000","last_change":"2024-04-14T11:01:46.639876+0000","last_active":"2024-04-14T11:08:12.721329+0000","last_peered":"2024-04-14T11:08:12.721329+0000","last_clean":"2024-04-14T11:08:12.721329+0000","last_became_active":"2024-04-14T10:58:04.209043+0000","last_became_peered":"2024-04-14T10:58:04.209043+0000","last_unstale":"2024-04-14T11:08:12.721329+0000","last_undegraded":"2024-04-14T11:08:12.721329+0000","last_fullsized":"2024-04-14T11:08:12.721329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1117,"log_dups_size":0,"ondisk_log_size":1117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:39:13.715767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00265679,"stat_sum":{"num_bytes":5503393,"num_objects":415,"num_object_clones":195,"num_object_copies":830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":415,"num_whiteouts":195,"num_read":16,"num_read_kb":16,"num_write":906,"num_write_kb":11229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"37'272","reported_seq":324,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.783867+0000","last_change":"2024-04-14T10:58:03.194409+0000","last_active":"2024-04-14T11:08:11.783867+0000","last_peered":"2024-04-14T11:08:11.783867+0000","last_clean":"2024-04-14T11:08:11.783867+0000","last_became_active":"2024-04-14T10:58:03.194074+0000","last_became_peered":"2024-04-14T10:58:03.194074+0000","last_unstale":"2024-04-14T11:08:11.783867+0000","last_undegraded":"2024-04-14T11:08:11.783867+0000","last_fullsized":"2024-04-14T11:08:11.783867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":272,"log_dups_size":0,"ondisk_log_size":272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":310,"num_write_kb":25219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"37'1144","reported_seq":3163,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.751234+0000","last_change":"2024-04-14T11:01:46.214667+0000","last_active":"2024-04-14T11:08:13.751234+0000","last_peered":"2024-04-14T11:08:13.751234+0000","last_clean":"2024-04-14T11:08:13.751234+0000","last_became_active":"2024-04-14T10:58:04.205147+0000","last_became_peered":"2024-04-14T10:58:04.205147+0000","last_unstale":"2024-04-14T11:08:13.751234+0000","last_undegraded":"2024-04-14T11:08:13.751234+0000","last_fullsized":"2024-04-14T11:08:13.751234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1144,"log_dups_size":0,"ondisk_log_size":1144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:59:01.354463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018052999999999999,"stat_sum":{"num_bytes":6929899,"num_objects":402,"num_object_clones":185,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":185,"num_read":129,"num_read_kb":3168,"num_write":934,"num_write_kb":8933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"37'274","reported_seq":326,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.785069+0000","last_change":"2024-04-14T10:58:03.198115+0000","last_active":"2024-04-14T11:08:11.785069+0000","last_peered":"2024-04-14T11:08:11.785069+0000","last_clean":"2024-04-14T11:08:11.785069+0000","last_became_active":"2024-04-14T10:58:03.197492+0000","last_became_peered":"2024-04-14T10:58:03.197492+0000","last_unstale":"2024-04-14T11:08:11.785069+0000","last_undegraded":"2024-04-14T11:08:11.785069+0000","last_fullsized":"2024-04-14T11:08:11.785069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:48:39.287165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":271,"num_write_kb":17144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"37'1134","reported_seq":3997,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.734906+0000","last_change":"2024-04-14T11:01:46.056373+0000","last_active":"2024-04-14T11:08:12.734906+0000","last_peered":"2024-04-14T11:08:12.734906+0000","last_clean":"2024-04-14T11:08:12.734906+0000","last_became_active":"2024-04-14T10:58:04.204600+0000","last_became_peered":"2024-04-14T10:58:04.204600+0000","last_unstale":"2024-04-14T11:08:12.734906+0000","last_undegraded":"2024-04-14T11:08:12.734906+0000","last_fullsized":"2024-04-14T11:08:12.734906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1134,"log_dups_size":0,"ondisk_log_size":1134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:12:27.607832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001467014,"stat_sum":{"num_bytes":23716624,"num_objects":409,"num_object_clones":187,"num_object_copies":818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":409,"num_whiteouts":187,"num_read":974,"num_read_kb":19247,"num_write":919,"num_write_kb":25081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"37'353","reported_seq":405,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.938172+0000","last_change":"2024-04-14T10:58:03.198599+0000","last_active":"2024-04-14T11:08:12.938172+0000","last_peered":"2024-04-14T11:08:12.938172+0000","last_clean":"2024-04-14T11:08:12.938172+0000","last_became_active":"2024-04-14T10:58:03.197549+0000","last_became_peered":"2024-04-14T10:58:03.197549+0000","last_unstale":"2024-04-14T11:08:12.938172+0000","last_undegraded":"2024-04-14T11:08:12.938172+0000","last_fullsized":"2024-04-14T11:08:12.938172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:51:56.836226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":349,"num_write_kb":21242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"37'1210","reported_seq":3576,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.738553+0000","last_change":"2024-04-14T11:01:46.640816+0000","last_active":"2024-04-14T11:08:12.738553+0000","last_peered":"2024-04-14T11:08:12.738553+0000","last_clean":"2024-04-14T11:08:12.738553+0000","last_became_active":"2024-04-14T10:58:04.201682+0000","last_became_peered":"2024-04-14T10:58:04.201682+0000","last_unstale":"2024-04-14T11:08:12.738553+0000","last_undegraded":"2024-04-14T11:08:12.738553+0000","last_fullsized":"2024-04-14T11:08:12.738553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:47:30.020829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003171901,"stat_sum":{"num_bytes":16160611,"num_objects":435,"num_object_clones":202,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":202,"num_read":492,"num_read_kb":8176,"num_write":983,"num_write_kb":22461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"37'682","reported_seq":734,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.932965+0000","last_change":"2024-04-14T10:58:03.199489+0000","last_active":"2024-04-14T11:08:12.932965+0000","last_peered":"2024-04-14T11:08:12.932965+0000","last_clean":"2024-04-14T11:08:12.932965+0000","last_became_active":"2024-04-14T10:58:03.199200+0000","last_became_peered":"2024-04-14T10:58:03.199200+0000","last_unstale":"2024-04-14T11:08:12.932965+0000","last_undegraded":"2024-04-14T11:08:12.932965+0000","last_fullsized":"2024-04-14T11:08:12.932965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":678,"num_write_kb":45877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"37'1125","reported_seq":3404,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.735492+0000","last_change":"2024-04-14T11:01:46.640533+0000","last_active":"2024-04-14T11:08:13.735492+0000","last_peered":"2024-04-14T11:08:13.735492+0000","last_clean":"2024-04-14T11:08:13.735492+0000","last_became_active":"2024-04-14T10:58:04.202975+0000","last_became_peered":"2024-04-14T10:58:04.202975+0000","last_unstale":"2024-04-14T11:08:13.735492+0000","last_undegraded":"2024-04-14T11:08:13.735492+0000","last_fullsized":"2024-04-14T11:08:13.735492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:55:56.034934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032651109999999998,"stat_sum":{"num_bytes":12406418,"num_objects":403,"num_object_clones":183,"num_object_copies":806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":403,"num_whiteouts":183,"num_read":386,"num_read_kb":8577,"num_write":914,"num_write_kb":14025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"37'418","reported_seq":470,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.937768+0000","last_change":"2024-04-14T10:58:03.195894+0000","last_active":"2024-04-14T11:08:12.937768+0000","last_peered":"2024-04-14T11:08:12.937768+0000","last_clean":"2024-04-14T11:08:12.937768+0000","last_became_active":"2024-04-14T10:58:03.195567+0000","last_became_peered":"2024-04-14T10:58:03.195567+0000","last_unstale":"2024-04-14T11:08:12.937768+0000","last_undegraded":"2024-04-14T11:08:12.937768+0000","last_fullsized":"2024-04-14T11:08:12.937768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:54:55.645035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":445,"num_write_kb":37732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"37'1176","reported_seq":3256,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.757447+0000","last_change":"2024-04-14T11:01:46.321158+0000","last_active":"2024-04-14T11:08:13.757447+0000","last_peered":"2024-04-14T11:08:13.757447+0000","last_clean":"2024-04-14T11:08:13.757447+0000","last_became_active":"2024-04-14T10:58:04.207016+0000","last_became_peered":"2024-04-14T10:58:04.207016+0000","last_unstale":"2024-04-14T11:08:13.757447+0000","last_undegraded":"2024-04-14T11:08:13.757447+0000","last_fullsized":"2024-04-14T11:08:13.757447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1176,"log_dups_size":0,"ondisk_log_size":1176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:24:18.724472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019271749999999999,"stat_sum":{"num_bytes":8320793,"num_objects":424,"num_object_clones":197,"num_object_copies":848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":424,"num_whiteouts":197,"num_read":201,"num_read_kb":4193,"num_write":954,"num_write_kb":14088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"37'1113","reported_seq":3675,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.743048+0000","last_change":"2024-04-14T11:01:46.448153+0000","last_active":"2024-04-14T11:08:12.743048+0000","last_peered":"2024-04-14T11:08:12.743048+0000","last_clean":"2024-04-14T11:08:12.743048+0000","last_became_active":"2024-04-14T10:58:44.514340+0000","last_became_peered":"2024-04-14T10:58:44.514340+0000","last_unstale":"2024-04-14T11:08:12.743048+0000","last_undegraded":"2024-04-14T11:08:12.743048+0000","last_fullsized":"2024-04-14T11:08:12.743048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1113,"log_dups_size":0,"ondisk_log_size":1113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:50:33.276616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077277900000000002,"stat_sum":{"num_bytes":20624331,"num_objects":409,"num_object_clones":192,"num_object_copies":818,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":409,"num_whiteouts":192,"num_read":685,"num_read_kb":17247,"num_write":900,"num_write_kb":26862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"37'236","reported_seq":288,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:14.374572+0000","last_change":"2024-04-14T10:58:03.197345+0000","last_active":"2024-04-14T11:08:14.374572+0000","last_peered":"2024-04-14T11:08:14.374572+0000","last_clean":"2024-04-14T11:08:14.374572+0000","last_became_active":"2024-04-14T10:58:03.196483+0000","last_became_peered":"2024-04-14T10:58:03.196483+0000","last_unstale":"2024-04-14T11:08:14.374572+0000","last_undegraded":"2024-04-14T11:08:14.374572+0000","last_fullsized":"2024-04-14T11:08:14.374572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:19:35.709585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":243,"num_write_kb":41692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'1260","reported_seq":3115,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:12.738109+0000","last_change":"2024-04-14T11:01:46.059613+0000","last_active":"2024-04-14T11:08:12.738109+0000","last_peered":"2024-04-14T11:08:12.738109+0000","last_clean":"2024-04-14T11:08:12.738109+0000","last_became_active":"2024-04-14T10:58:04.197947+0000","last_became_peered":"2024-04-14T10:58:04.197947+0000","last_unstale":"2024-04-14T11:08:12.738109+0000","last_undegraded":"2024-04-14T11:08:12.738109+0000","last_fullsized":"2024-04-14T11:08:12.738109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:53:36.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003375477,"stat_sum":{"num_bytes":4165041,"num_objects":499,"num_object_clones":234,"num_object_copies":998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":499,"num_whiteouts":234,"num_read":13,"num_read_kb":13,"num_write":1007,"num_write_kb":10901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"37'433","reported_seq":485,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:11.784120+0000","last_change":"2024-04-14T10:58:03.196091+0000","last_active":"2024-04-14T11:08:11.784120+0000","last_peered":"2024-04-14T11:08:11.784120+0000","last_clean":"2024-04-14T11:08:11.784120+0000","last_became_active":"2024-04-14T10:58:03.195708+0000","last_became_peered":"2024-04-14T10:58:03.195708+0000","last_unstale":"2024-04-14T11:08:11.784120+0000","last_undegraded":"2024-04-14T11:08:11.784120+0000","last_fullsized":"2024-04-14T11:08:11.784120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:20:56.421673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":435,"num_write_kb":66338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"37'1122","reported_seq":3770,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:13.764344+0000","last_change":"2024-04-14T11:01:46.447900+0000","last_active":"2024-04-14T11:08:13.764344+0000","last_peered":"2024-04-14T11:08:13.764344+0000","last_clean":"2024-04-14T11:08:13.764344+0000","last_became_active":"2024-04-14T10:58:44.515250+0000","last_became_peered":"2024-04-14T10:58:44.515250+0000","last_unstale":"2024-04-14T11:08:13.764344+0000","last_undegraded":"2024-04-14T11:08:13.764344+0000","last_fullsized":"2024-04-14T11:08:13.764344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1122,"log_dups_size":0,"ondisk_log_size":1122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:45:31.110918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089051500000000003,"stat_sum":{"num_bytes":17489818,"num_objects":435,"num_object_clones":203,"num_object_copies":870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":435,"num_whiteouts":203,"num_read":781,"num_read_kb":14803,"num_write":899,"num_write_kb":18515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"37'580","reported_seq":633,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.815545+0000","last_change":"2024-04-14T10:58:03.199030+0000","last_active":"2024-04-14T11:08:15.815545+0000","last_peered":"2024-04-14T11:08:15.815545+0000","last_clean":"2024-04-14T11:08:15.815545+0000","last_became_active":"2024-04-14T10:58:03.198727+0000","last_became_peered":"2024-04-14T10:58:03.198727+0000","last_unstale":"2024-04-14T11:08:15.815545+0000","last_undegraded":"2024-04-14T11:08:15.815545+0000","last_fullsized":"2024-04-14T11:08:15.815545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T22:01:36.140115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12642331,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":569,"num_write_kb":41754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"37'1114","reported_seq":3150,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.942396+0000","last_change":"2024-04-14T11:01:46.640496+0000","last_active":"2024-04-14T11:08:15.942396+0000","last_peered":"2024-04-14T11:08:15.942396+0000","last_clean":"2024-04-14T11:08:15.942396+0000","last_became_active":"2024-04-14T10:58:04.206245+0000","last_became_peered":"2024-04-14T10:58:04.206245+0000","last_unstale":"2024-04-14T11:08:15.942396+0000","last_undegraded":"2024-04-14T11:08:15.942396+0000","last_fullsized":"2024-04-14T11:08:15.942396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:03.172149+0000","last_clean_scrub_stamp":"2024-04-14T10:58:03.172149+0000","objects_scrubbed":0,"log_size":1114,"log_dups_size":0,"ondisk_log_size":1114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:38.030909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032321239999999998,"stat_sum":{"num_bytes":7637967,"num_objects":402,"num_object_clones":183,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":402,"num_whiteouts":183,"num_read":142,"num_read_kb":4108,"num_write":908,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"37'392","reported_seq":444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-14T11:08:15.756195+0000","last_change":"2024-04-14T10:58:03.194015+0000","last_active":"2024-04-14T11:08:15.756195+0000","last_peered":"2024-04-14T11:08:15.756195+0000","last_clean":"2024-04-14T11:08:15.756195+0000","last_became_active":"2024-04-14T10:58:03.193720+0000","last_became_peered":"2024-04-14T10:58:03.193720+0000","last_unstale":"2024-04-14T11:08:15.756195+0000","last_undegraded":"2024-04-14T11:08:15.756195+0000","last_fullsized":"2024-04-14T11:08:15.756195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:58:02.167536+0000","last_clean_scrub_stamp":"2024-04-14T10:58:02.167536+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:52:09.791663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":397,"num_write_kb":17248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1014283614,"num_objects":27782,"num_object_clones":12826,"num_object_copies":55564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27782,"num_whiteouts":12700,"num_read":30594,"num_read_kb":671228,"num_write":60516,"num_write_kb":1315345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2096480256,"data_stored":2029975296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74796,"ondisk_log_size":74796,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":570002365,"num_objects":1310,"num_object_clones":0,"num_object_copies":2620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1310,"num_whiteouts":0,"num_read":913,"num_read_kb":3961,"num_write":14124,"num_write_kb":1279263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1111,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1140154368,"data_stored":1140004730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13243,"ondisk_log_size":13243,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":490160,"kb_used_data":409000,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93881680,"statfs":{"total":96636764160,"available":96134840320,"internally_reserved":0,"allocated":418816000,"data_stored":409229671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446800,"kb_used_data":365704,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93925040,"statfs":{"total":96636764160,"available":96179240960,"internally_reserved":0,"allocated":374480896,"data_stored":367459550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83032518},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":485212,"kb_used_data":404052,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93886628,"statfs":{"total":96636764160,"available":96139907072,"internally_reserved":0,"allocated":413749248,"data_stored":404010765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":500152,"kb_used_data":414832,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93871688,"statfs":{"total":96636764160,"available":96124608512,"internally_reserved":0,"allocated":424787968,"data_stored":415215258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":568516,"kb_used_data":479036,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":93803324,"statfs":{"total":96636764160,"available":96054603776,"internally_reserved":0,"allocated":490532864,"data_stored":480451852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":91617735},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574977,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345828,"kb_used_data":296604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94026012,"statfs":{"total":96636764160,"available":96282636288,"internally_reserved":0,"allocated":303722496,"data_stored":297693489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":459072,"kb_used_data":377976,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":93912768,"statfs":{"total":96636764160,"available":96166674432,"internally_reserved":0,"allocated":387047424,"data_stored":380077165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":503284,"kb_used_data":417964,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93868556,"statfs":{"total":96636764160,"available":96121401344,"internally_reserved":0,"allocated":427995136,"data_stored":418467186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87357894},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":104935424,"data_stored":104917679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":125853696,"data_stored":125832585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":91807744,"data_stored":91785423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":188338176,"data_stored":188314841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":121651200,"data_stored":121638492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":142626816,"data_stored":142607714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":192954368,"data_stored":192939775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":171986944,"data_stored":171968221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":322052096,"data_stored":312778564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260780032,"data_stored":254064005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":211501056,"data_stored":205727491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":301780992,"data_stored":291956862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":302723072,"data_stored":293396191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":270708736,"data_stored":261222476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":181112832,"data_stored":174339200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":245821440,"data_stored":236490507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T11:08:18.535 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T11:08:18.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T11:08:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.680+0000 7f01d36de640 1 Processor -- start 2024-04-14T11:08:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.680+0000 7f01d36de640 1 -- start start 2024-04-14T11:08:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d36de640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01cc067720 0x7f01cc067b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d36de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc0c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d36de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01cc0c9330 con 0x7f01cc154e90 2024-04-14T11:08:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d36de640 1 -- --> v2:172.21.15.84:3300/0 -- mon_getmap magic: 0 -- 0x7f01cc15bcc0 con 0x7f01cc067720 2024-04-14T11:08:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d36de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01cc15b140 con 0x7f01cc0c8960 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01cc067720 0x7f01cc067b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 --2- >> v2:172.21.15.84:3300/0 conn(0x7f01cc067720 0x7f01cc067b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59746/0 (socket says 172.21.15.84:59746) 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 -- 172.21.15.84:0/3924114921 learned_addr learned my addr 172.21.15.84:0/3924114921 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3924114921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc0c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 -- 172.21.15.84:0/3924114921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01cc0c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3924114921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc0c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 -- 172.21.15.84:0/3924114921 >> v1:172.21.15.175:6789/0 conn(0x7f01cc154e90 legacy=0x7f01cc06ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.681+0000 7f01d0c79640 1 -- 172.21.15.84:0/3924114921 --> v2:172.21.15.84:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc15b420 con 0x7f01cc067720 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.682+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3924114921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc067720 0x7f01cc067b60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f01cc15be40 tx=0x7f01bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953840d6eb75f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.682+0000 7f01c3fff640 1 -- 172.21.15.84:0/3924114921 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc035020 con 0x7f01cc067720 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.682+0000 7f01c3fff640 1 -- 172.21.15.84:0/3924114921 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01bc031640 con 0x7f01cc067720 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.682+0000 7f01c3fff640 1 -- 172.21.15.84:0/3924114921 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc02d040 con 0x7f01cc067720 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 -- 172.21.15.84:0/3924114921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc067720 msgr2=0x7f01cc067b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 --2- 172.21.15.84:0/3924114921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc067720 0x7f01cc067b60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f01cc15be40 tx=0x7f01bc02b8f0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 -- 172.21.15.84:0/3924114921 shutdown_connections 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 --2- 172.21.15.84:0/3924114921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc0c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 --2- 172.21.15.84:0/3924114921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc067720 0x7f01cc067b60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 -- 172.21.15.84:0/3924114921 >> 172.21.15.84:0/3924114921 conn(0x7f01cc0c9f70 msgr2=0x7f01cc0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T11:08:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 -- 172.21.15.84:0/3924114921 shutdown_connections 2024-04-14T11:08:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.683+0000 7f01d36de640 1 -- 172.21.15.84:0/3924114921 wait complete. 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 Processor -- start 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 -- start start 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01cc1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc0c8440 con 0x7f01cc154e90 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc15b9e0 con 0x7f01cc067720 2024-04-14T11:08:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.684+0000 7f01d36de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01cc06ba50 con 0x7f01cc0c8960 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59756/0 (socket says 172.21.15.84:59756) 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 learned_addr learned my addr 172.21.15.84:0/3509133990 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01cc1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01cc1532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01cc1532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01cc1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T11:08:18.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01cc1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc1581a0 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f01c400efc0 tx=0x7f01c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4018020 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c4014480 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01d36de640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc158480 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.685+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c4014870 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.686+0000 7f01d36de640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1f0dd0 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.687+0000 7f01d36de640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc1f08e0 con 0x7f01cc154e90 2024-04-14T11:08:18.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.687+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01c4005d10 con 0x7f01cc154e90 2024-04-14T11:08:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.688+0000 7f01c1ffb640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.688+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5940+0+0 (secure 0 0 0) 0x7f01c408c630 con 0x7f01cc154e90 2024-04-14T11:08:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.688+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.688+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01b006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f01c80016e0 tx=0x7f01c8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T11:08:18.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.693+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187173 (secure 0 0 0) 0x7f01c4022070 con 0x7f01cc154e90 2024-04-14T11:08:18.685 INFO:tasks.ceph.osd.0:Sent signal 15 2024-04-14T11:08:18.685 INFO:tasks.ceph.osd.1:Sent signal 15 2024-04-14T11:08:18.685 INFO:tasks.ceph.osd.2:Sent signal 15 2024-04-14T11:08:18.685 INFO:tasks.ceph.osd.3:Sent signal 15 2024-04-14T11:08:18.686 INFO:tasks.ceph.osd.4:Sent signal 15 2024-04-14T11:08:18.686 INFO:tasks.ceph.osd.5:Sent signal 15 2024-04-14T11:08:18.686 INFO:tasks.ceph.osd.6:Sent signal 15 2024-04-14T11:08:18.686 INFO:tasks.ceph.osd.7:Sent signal 15 2024-04-14T11:08:18.687 INFO:tasks.ceph.mds.a:Sent signal 15 2024-04-14T11:08:18.687 INFO:tasks.ceph.mds.c:Sent signal 15 2024-04-14T11:08:18.687 INFO:tasks.ceph.mds.e:Sent signal 15 2024-04-14T11:08:18.687 INFO:tasks.ceph.mds.b:Sent signal 15 2024-04-14T11:08:18.688 INFO:tasks.ceph.mds.d:Sent signal 15 2024-04-14T11:08:18.688 INFO:tasks.ceph.mds.f:Sent signal 15 2024-04-14T11:08:18.688 INFO:tasks.ceph.mon.a:Sent signal 15 2024-04-14T11:08:18.688 INFO:tasks.ceph.mon.b:Sent signal 15 2024-04-14T11:08:18.689 INFO:tasks.ceph.mon.c:Sent signal 15 2024-04-14T11:08:18.689 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-04-14T11:08:18.689 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-04-14T11:08:18.690 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T11:08:18.696+0000 7f30669f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 37618) UID: 0 2024-04-14T11:08:18.690 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T11:08:18.696+0000 7f30669f9640 -1 osd.4 37 *** Got signal Terminated *** 2024-04-14T11:08:18.691 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-14T11:08:18.696+0000 7f30669f9640 -1 osd.4 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.691 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T11:08:18.695+0000 7fe12f9f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37462) UID: 0 2024-04-14T11:08:18.691 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T11:08:18.695+0000 7fe12f9f9640 -1 osd.0 37 *** Got signal Terminated *** 2024-04-14T11:08:18.691 INFO:tasks.ceph.osd.0.smithi084.stderr:2024-04-14T11:08:18.695+0000 7fe12f9f9640 -1 osd.0 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.692 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T11:08:18.696+0000 7f1c207f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 37620) UID: 0 2024-04-14T11:08:18.692 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T11:08:18.696+0000 7f1c207f9640 -1 osd.5 37 *** Got signal Terminated *** 2024-04-14T11:08:18.692 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-14T11:08:18.696+0000 7f1c207f9640 -1 osd.5 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.692 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T11:08:18.695+0000 7f565afed640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37464) UID: 0 2024-04-14T11:08:18.693 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T11:08:18.695+0000 7f565afed640 -1 osd.1 37 *** Got signal Terminated *** 2024-04-14T11:08:18.693 INFO:tasks.ceph.osd.1.smithi084.stderr:2024-04-14T11:08:18.695+0000 7f565afed640 -1 osd.1 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.693 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T11:08:18.696+0000 7f5d32ff9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 37467) UID: 0 2024-04-14T11:08:18.693 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T11:08:18.696+0000 7f5d32ff9640 -1 osd.2 37 *** Got signal Terminated *** 2024-04-14T11:08:18.694 INFO:tasks.ceph.osd.2.smithi084.stderr:2024-04-14T11:08:18.696+0000 7f5d32ff9640 -1 osd.2 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.694 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T11:08:18.697+0000 7f663aff9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37621) UID: 0 2024-04-14T11:08:18.694 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T11:08:18.697+0000 7f663aff9640 -1 osd.6 37 *** Got signal Terminated *** 2024-04-14T11:08:18.694 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-14T11:08:18.697+0000 7f663aff9640 -1 osd.6 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.695 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T11:08:18.696+0000 7f4f2e3f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37469) UID: 0 2024-04-14T11:08:18.695 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T11:08:18.696+0000 7f4f2e3f9640 -1 osd.3 37 *** Got signal Terminated *** 2024-04-14T11:08:18.695 INFO:tasks.ceph.osd.3.smithi084.stderr:2024-04-14T11:08:18.696+0000 7f4f2e3f9640 -1 osd.3 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.695 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T11:08:18.697+0000 7fee62bf9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 37624) UID: 0 2024-04-14T11:08:18.695 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T11:08:18.697+0000 7fee62bf9640 -1 osd.7 37 *** Got signal Terminated *** 2024-04-14T11:08:18.696 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-14T11:08:18.697+0000 7fee62bf9640 -1 osd.7 37 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-14T11:08:18.696 INFO:tasks.ceph.mds.a.smithi084.stderr:2024-04-14T11:08:18.697+0000 7f642adf9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 43167) UID: 0 2024-04-14T11:08:18.696 INFO:tasks.ceph.mds.a.smithi084.stderr:2024-04-14T11:08:18.697+0000 7f642adf9640 -1 mds.a *** got signal Terminated *** 2024-04-14T11:08:18.697 INFO:tasks.ceph.mds.c.smithi084.stderr:2024-04-14T11:08:18.697+0000 7f73c71f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 43170) UID: 0 2024-04-14T11:08:18.697 INFO:tasks.ceph.mds.c.smithi084.stderr:2024-04-14T11:08:18.697+0000 7f73c71f9640 -1 mds.c *** got signal Terminated *** 2024-04-14T11:08:18.697 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-14T11:08:18.698+0000 7fe1299f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 43573) UID: 0 2024-04-14T11:08:18.697 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-14T11:08:18.698+0000 7fe1299f9640 -1 mds.b *** got signal Terminated *** 2024-04-14T11:08:18.698 INFO:tasks.ceph.mds.e.smithi084.stderr:2024-04-14T11:08:18.698+0000 7f3a4d7f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i e (PID: 43175) UID: 0 2024-04-14T11:08:18.698 INFO:tasks.ceph.mds.e.smithi084.stderr:2024-04-14T11:08:18.698+0000 7f3a4d7f9640 -1 mds.e *** got signal Terminated *** 2024-04-14T11:08:18.698 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-04-14T11:08:18.698+0000 7fe160bf9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 43574) UID: 0 2024-04-14T11:08:18.698 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-04-14T11:08:18.698+0000 7fe160bf9640 -1 mds.d *** got signal Terminated *** 2024-04-14T11:08:18.699 INFO:tasks.ceph.mon.a.smithi084.stderr:2024-04-14T11:08:18.699+0000 7ff20cbfc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 37198) UID: 0 2024-04-14T11:08:18.699 INFO:tasks.ceph.mon.a.smithi084.stderr:2024-04-14T11:08:18.699+0000 7ff20cbfc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-14T11:08:18.699 INFO:tasks.ceph.mds.f.smithi175.stderr:2024-04-14T11:08:18.699+0000 7fe73dbf9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i f (PID: 43577) UID: 0 2024-04-14T11:08:18.699 INFO:tasks.ceph.mds.f.smithi175.stderr:2024-04-14T11:08:18.699+0000 7fe73dbf9640 -1 mds.f *** got signal Terminated *** 2024-04-14T11:08:18.700 INFO:tasks.ceph.mgr.y.smithi084.stderr:2024-04-14T11:08:18.699+0000 7fd55fdf7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 37235) UID: 0 2024-04-14T11:08:18.700 INFO:tasks.ceph.mon.b.smithi175.stderr:2024-04-14T11:08:18.699+0000 7f28875fc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 37048) UID: 0 2024-04-14T11:08:18.700 INFO:tasks.ceph.mon.b.smithi175.stderr:2024-04-14T11:08:18.699+0000 7f28875fc640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-14T11:08:18.701 INFO:tasks.ceph.mon.c.smithi175.stderr:2024-04-14T11:08:18.699+0000 7fde4f495640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 37051) UID: 0 2024-04-14T11:08:18.701 INFO:tasks.ceph.mon.c.smithi175.stderr:2024-04-14T11:08:18.699+0000 7fde4f495640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-14T11:08:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 msgr2=0x7f01cc14ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-14T11:08:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 msgr2=0x7f01cc14ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-14T11:08:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f01c400efc0 tx=0x7f01c400c490 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T11:08:18.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f01c400efc0 tx=0x7f01c400c490 comp rx=0 tx=0).stop 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 msgr2=0x7f01cc14ced0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01cc154e90 0x7f01cc14ced0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01b0076cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01b007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01b0079e60 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01cc067720 2024-04-14T11:08:18.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01b007c2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01b007c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01b0076cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01b0076cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01b0079450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01b0079450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T11:08:18.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.700+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.719+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-04-14T11:08:18.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.719+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-14T11:08:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.719+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01b006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f01c80016e0 tx=0x7f01c8009040 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T11:08:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.719+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01b006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f01c80016e0 tx=0x7f01c8009040 comp rx=0 tx=0).stop 2024-04-14T11:08:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.719+0000 7f01c1ffb640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01b006edb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-14T11:08:18.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.719+0000 7f01c1ffb640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01b006edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:18.890 INFO:tasks.ceph.mgr.x.smithi175.stderr:daemon-helper: command crashed with signal 15 2024-04-14T11:08:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.901+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01b007c2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.901+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01b007c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.901+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01b0076cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.901+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01b0079450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.901+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:18.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:18.901+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01b0076cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:19.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.302+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01b007c2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:19.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.302+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01b007c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:19.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.302+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01b0076cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:19.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.302+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01b0076cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:19.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.302+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01b0079450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:19.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.302+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.688+0000 7f01b7fff640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.688+0000 7f01b7fff640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01cc069c30 con 0x7f01b006c8f0 2024-04-14T11:08:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.688+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:19.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.688+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:19.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.889+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:19.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:19.889+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.103+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01b007c2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.103+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01b007c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.103+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01b0076cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.103+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01b0079450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:20.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.103+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01b0076cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:20.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.103+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:20.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.290+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:20.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:20.290+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:21.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.091+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:21.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.091+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01b0079450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01b0079450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:21.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01b0076cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01b0076cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01b007c2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01b007c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:21.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01b0079e60 2024-04-14T11:08:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01cc067720 2024-04-14T11:08:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:08:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:21.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:21.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.685+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.886+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.886+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.886+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.886+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.886+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:21.886+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.287+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:22.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.287+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.287+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.287+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.287+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:22.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.287+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:22.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.692+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:22.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:22.692+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:23.088+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:23.088+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:23.088+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:23.088+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:23.088+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:23.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:23.088+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:24.690+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:24.690+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:24.690+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:24.690+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:24.690+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:24.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:24.690+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:25.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:25.894+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:25.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:25.894+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:27.892+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:27.892+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:27.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:27.893+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:27.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:27.893+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:27.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:27.893+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:27.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:27.893+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:28.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 msgr2=0x7f01a800a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01cc067720 0x7f01a800a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8007c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:28.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01b0079e60 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01a800ad10 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:28.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:28.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.436+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:28.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.637+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:28.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.637+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:28.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.637+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:28.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.637+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:28.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.637+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:28.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:28.637+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.038+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.038+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.038+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:29.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.038+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.038+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:29.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.038+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.839+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.839+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.839+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:29.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.839+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.839+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:29.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:29.839+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:31.441+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:31.441+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:31.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:31.441+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:31.441+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:31.441+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:31.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:31.441+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:32.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:32.295+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:32.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:32.295+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:08:34.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:34.644+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:34.644+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:34.644+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:34.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:34.644+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:34.644+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:34.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:34.644+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:38.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8003610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8003610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 msgr2=0x7f01a800d100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a800ad10 0x7f01a800d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:38.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01b0079e60 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01a8005ba0 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.561+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.562+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:38.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.562+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:38.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.562+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:38.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.562+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:38.751 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.762+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:38.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.762+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:38.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.763+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:38.752 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.763+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.763+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:38.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:38.763+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:39.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.163+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:39.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.163+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.164+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.164+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.164+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:39.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.164+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:39.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.964+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:39.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.964+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:39.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.965+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:39.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.965+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:39.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.965+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:39.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:39.965+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:41.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:41.564+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:41.555 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:41.564+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:41.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:41.566+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:41.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:41.566+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:41.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:41.566+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:41.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:41.566+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:44.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:44.768+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:44.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:44.768+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:44.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:44.769+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:44.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:44.769+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:44.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:44.769+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:44.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:44.769+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:45.095+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:08:45.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:45.095+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:08:51.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:51.175+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:51.175+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:08:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:51.175+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:51.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:51.175+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:08:51.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:51.176+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:51.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:51.176+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:08:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:53.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:08:53.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01b0079e60 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01a8005ba0 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:53.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.748+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:08:53.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.949+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.949+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.949+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.949+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.949+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:53.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:53.949+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:08:54.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:54.350+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:54.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:54.350+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:54.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:54.350+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:54.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:54.350+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:54.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:54.350+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:54.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:54.350+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:08:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:55.151+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:55.151+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:55.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:55.151+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:55.151+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:55.151+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:55.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:55.151+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:08:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:56.752+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:56.752+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:56.752+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:56.752+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:56.752+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:56.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:56.752+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:08:59.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:59.954+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:08:59.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:59.954+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:59.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:59.956+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:08:59.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:59.956+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:08:59.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:59.956+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:08:59.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:08:59.956+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:00.096+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:09:00.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:00.096+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:06.361+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:06.361+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:06.362+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:06.362+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:06.362+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:06.362+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:15.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:15.105+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:09:15.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:15.105+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:09:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:09:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:09:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:09:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a80081d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:09:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a80081d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:09:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:09:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:09:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:09:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01b0079e60 2024-04-14T11:09:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01a8005ba0 2024-04-14T11:09:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:09:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:09:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:09:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.530+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:09:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.731+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.731+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:09:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.731+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.731+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:09:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.732+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:16.732+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:09:17.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.132+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:17.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.132+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:09:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.132+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.132+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:09:17.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.133+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.133+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:09:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.933+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.933+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:09:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.933+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.933+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:09:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.934+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:17.934+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:09:19.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:19.534+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:19.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:19.534+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:09:19.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:19.535+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:19.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:19.535+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:09:19.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:19.536+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:19.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:19.536+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:09:22.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:22.738+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:22.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:22.738+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:22.739+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:22.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:22.739+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:22.740+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:22.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:22.740+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:29.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:29.144+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:29.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:29.144+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:29.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:29.145+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:29.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:29.145+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:29.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:29.146+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:29.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:29.146+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:30.107+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:09:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:30.107+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:38.246 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:09:38.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:09:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:41.955+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:41.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:41.955+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:41.958+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:41.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:41.959+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:41.959+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:41.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:41.959+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:45.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:45.109+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:09:45.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:45.109+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:09:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a80064c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:09:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a80064c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:09:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:09:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:09:46.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 msgr2=0x7f01a8006a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01b0079e60 0x7f01a8006a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01a8008230 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01a8005ba0 2024-04-14T11:09:46.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:09:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:09:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:09:46.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.530+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:09:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.731+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.731+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:09:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.731+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.731+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:09:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.731+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:46.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:46.731+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:09:47.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.132+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:47.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.132+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:09:47.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.132+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:47.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.132+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:09:47.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.132+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:47.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.132+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:09:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.933+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.933+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:09:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.933+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.933+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.933+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:09:47.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:47.933+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:09:49.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:49.534+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:49.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:49.534+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:09:49.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:49.535+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:49.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:49.535+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:49.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:49.535+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:09:49.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:49.535+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-14T11:09:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:52.738+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:52.738+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:52.738+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:52.738+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:52.738+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:52.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:52.738+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-14T11:09:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:59.145+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:09:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:59.145+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:59.145+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:09:59.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:59.145+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:09:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:59.145+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:09:59.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:09:59.145+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-04-14T11:10:00.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:00.110+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:10:00.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:00.110+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:10:08.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:10:08.400 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:10:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:11.957+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:10:11.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:11.957+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:10:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:11.957+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:10:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:11.957+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:10:11.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:11.957+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:10:11.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:11.957+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:10:15.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:15.113+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 msgr2=0x7f01cc1f14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:6832/921762080 2024-04-14T11:10:15.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:15.113+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:6832/921762080,v1:172.21.15.84:6833/921762080] conn(0x7f01b006c8f0 0x7f01cc1f14b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-04-14T11:10:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8007480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:10:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:10:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:10:16.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 msgr2=0x7f01a8006f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a8008230 0x7f01a8006f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 0x7f01a80068a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cdf0 con 0x7f01a80064c0 2024-04-14T11:10:16.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f01b007cf70 con 0x7f01a8005ba0 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01c0ff9640 1 -- 172.21.15.84:0/3509133990 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f01b007d140 con 0x7f01cc0c8960 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 msgr2=0x7f01a80068a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 0x7f01a80068a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:10:16.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.531+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T11:10:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.732+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 msgr2=0x7f01a80068a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:10:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.732+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 0x7f01a80068a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:10:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.732+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:10:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.732+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:10:16.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.732+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:10:16.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:16.732+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T11:10:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.133+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 msgr2=0x7f01a80068a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:10:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.133+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 0x7f01a80068a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:10:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.133+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:10:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.133+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:10:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.133+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:10:17.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.133+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T11:10:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.934+0000 7f01d0c79640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 msgr2=0x7f01a80068a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.84:3300/0 2024-04-14T11:10:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.934+0000 7f01d0c79640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f01a80064c0 0x7f01a80068a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:10:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.934+0000 7f01d1c7b640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 msgr2=0x7f01a8005f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3300/0 2024-04-14T11:10:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.934+0000 7f01d147a640 1 -- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 msgr2=0x7f01a8006de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.175:3301/0 2024-04-14T11:10:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.934+0000 7f01d1c7b640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01a8005ba0 0x7f01a8005f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:10:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-14T11:10:17.934+0000 7f01d147a640 1 --2- 172.21.15.84:0/3509133990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01cc0c8960 0x7f01a8006de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T11:10:18.602 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-14T11:10:18.602 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 294, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 247, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1242, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-14T11:10:18.617 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-14T11:10:18.617 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T11:10:18.617 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.621 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T11:10:18.621 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T11:10:18.621 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.621 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T11:10:18.622 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-14T11:10:18.622 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.622 INFO:tasks.ceph.mds.e:Stopped 2024-04-14T11:10:18.622 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T11:10:18.622 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.622 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T11:10:18.623 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-14T11:10:18.623 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.623 INFO:tasks.ceph.mds.d:Stopped 2024-04-14T11:10:18.623 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-14T11:10:18.623 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.623 INFO:tasks.ceph.mds.f:Stopped 2024-04-14T11:10:18.624 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-14T11:10:18.624 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-14T11:10:18.624 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.624 INFO:tasks.ceph.osd.0:Stopped 2024-04-14T11:10:18.624 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-14T11:10:18.624 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.624 INFO:tasks.ceph.osd.1:Stopped 2024-04-14T11:10:18.625 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-14T11:10:18.625 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.625 INFO:tasks.ceph.osd.2:Stopped 2024-04-14T11:10:18.625 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-14T11:10:18.625 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.625 INFO:tasks.ceph.osd.3:Stopped 2024-04-14T11:10:18.626 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-14T11:10:18.626 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.626 INFO:tasks.ceph.osd.4:Stopped 2024-04-14T11:10:18.626 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-14T11:10:18.626 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.626 INFO:tasks.ceph.osd.5:Stopped 2024-04-14T11:10:18.626 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-14T11:10:18.627 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.627 INFO:tasks.ceph.osd.6:Stopped 2024-04-14T11:10:18.627 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-14T11:10:18.627 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.627 INFO:tasks.ceph.osd.7:Stopped 2024-04-14T11:10:18.627 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-14T11:10:18.628 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-14T11:10:18.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.628 INFO:tasks.ceph.mgr.y:Stopped 2024-04-14T11:10:18.628 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-14T11:10:18.628 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T11:10:18.628 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 294, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 247, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1242, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi175 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-04-14T11:10:18.643 INFO:tasks.ceph.mgr.x:Stopped 2024-04-14T11:10:18.643 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-14T11:10:18.643 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-14T11:10:18.643 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.644 INFO:tasks.ceph.mon.a:Stopped 2024-04-14T11:10:18.644 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-14T11:10:18.644 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.646 INFO:tasks.ceph.mon.b:Stopped 2024-04-14T11:10:18.647 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-14T11:10:18.647 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T11:10:18.647 INFO:tasks.ceph.mon.c:Stopped 2024-04-14T11:10:18.647 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-14T11:10:18.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-14T11:10:18.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T11:10:18.784 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-14T11:10:18.903 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T11:10:18.903 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-14T11:10:18.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T11:10:18.984 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-14T11:10:19.039 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T11:10:19.039 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-14T11:10:19.091 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T11:10:19.092 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-14T11:10:19.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T11:10:19.196 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-14T11:10:19.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T11:10:19.261 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-14T11:10:19.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T11:10:19.319 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-14T11:10:19.377 INFO:tasks.ceph:Archiving mon data... 2024-04-14T11:10:19.378 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/data/mon.a.tgz 2024-04-14T11:10:19.378 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-04-14T11:10:19.394 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.nhthKjvntG 2024-04-14T11:10:19.394 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nhthKjvntG 2024-04-14T11:10:19.558 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.nhthKjvntG 2024-04-14T11:10:19.643 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.nhthKjvntG is 381KB 2024-04-14T11:10:19.742 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.nhthKjvntG 2024-04-14T11:10:19.756 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/data/mon.b.tgz 2024-04-14T11:10:19.756 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-14T11:10:19.772 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.J4T8utMrCd 2024-04-14T11:10:19.772 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.J4T8utMrCd 2024-04-14T11:10:19.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.J4T8utMrCd 2024-04-14T11:10:20.001 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.J4T8utMrCd is 387KB 2024-04-14T11:10:20.100 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.J4T8utMrCd 2024-04-14T11:10:20.115 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/data/mon.c.tgz 2024-04-14T11:10:20.115 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-14T11:10:20.168 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.33XV009Zjt 2024-04-14T11:10:20.169 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.33XV009Zjt 2024-04-14T11:10:20.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.33XV009Zjt 2024-04-14T11:10:20.393 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.33XV009Zjt is 387KB 2024-04-14T11:10:20.489 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.33XV009Zjt 2024-04-14T11:10:20.503 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-14T11:10:20.503 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T11:10:20.505 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T11:10:20.588 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T11:10:20.624 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T11:10:20.624 INFO:tasks.ceph:Archiving crash dumps... 2024-04-14T11:10:20.626 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/remote/smithi084/crash 2024-04-14T11:10:20.627 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T11:10:20.657 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/remote/smithi175/crash 2024-04-14T11:10:20.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T11:10:20.690 INFO:tasks.ceph:Shutting down logrotate 2024-04-14T11:10:20.690 DEBUG:teuthology.orchestra.run.smithi084:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:10:20.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T11:10:20.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T11:10:20.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T11:10:20.838 INFO:tasks.ceph:Compressing logs... 2024-04-14T11:10:20.838 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T11:10:20.853 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T11:10:20.926 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-14T11:10:20.927 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37487.log 2024-04-14T11:10:20.927 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37287.log 2024-04-14T11:10:20.927 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37487.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T11:10:20.927 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37287.log: gzip -5 87.4% --verbose -- /var/log/ceph/ceph-client.admin.37367.log -- replaced with /var/log/ceph/ceph-client.admin.37487.log.gz 2024-04-14T11:10:20.927 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37287.log.gz 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37447.log/var/log/ceph/ceph-client.admin.37367.log: 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37527.log 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37447.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-14T11:10:20.928 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37447.log.gz 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37527.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37527.log.gz 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37407.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.f.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2024-04-14T11:10:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-14T11:10:20.930 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose/var/log/ceph/ceph-mgr.x.log: -- /var/log/ceph/ceph-mon.b.log 2024-04-14T11:10:20.930 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T11:10:20.930 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-04-14T11:10:20.930 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-14T11:10:20.934 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-14T11:10:20.934 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37247.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-04-14T11:10:20.943 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37327.log 2024-04-14T11:10:20.956 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-14T11:10:20.956 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37327.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37327.log.gz 2024-04-14T11:10:20.966 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47296.log 2024-04-14T11:10:20.966 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49038.log 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47044.log 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.49038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47296.log.gz 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47044.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49038.log.gz 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47044.log.gz 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-04-14T11:10:20.967 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47440.log 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47212.log 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43180.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47440.log.gz 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51893.log 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44690.log 2024-04-14T11:10:20.968 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2024-04-14T11:10:20.969 INFO:teuthology.orchestra.run.smithi084.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47212.log.gz 2024-04-14T11:10:20.969 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44690.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51893.log.gz 2024-04-14T11:10:20.969 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51444.log 2024-04-14T11:10:20.969 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52451.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44690.log.gz 2024-04-14T11:10:20.969 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43065.log 2024-04-14T11:10:20.969 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43408.log 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7%/var/log/ceph/ceph-client.admin.43065.log: -- replaced with /var/log/ceph/ceph-client.admin.51444.log.gz 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44144.log 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43408.log: gzip 89.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.43065.log.gz 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51384.log 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44144.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43408.log.gz 2024-04-14T11:10:20.970 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44144.log.gz 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51486.log 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44060.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51384.log.gz 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52535.log 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51486.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51486.log.gz 2024-04-14T11:10:20.971 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52247.log 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43892.log 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52247.log.gz 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47398.log 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.52535.log.gz 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45446.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43892.log.gz 2024-04-14T11:10:20.972 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51292.log 2024-04-14T11:10:20.973 INFO:teuthology.orchestra.run.smithi084.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2024-04-14T11:10:20.973 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44702.log 2024-04-14T11:10:20.973 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47398.log.gz 2024-04-14T11:10:20.973 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45038.log 2024-04-14T11:10:20.973 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43366.log 2024-04-14T11:10:20.973 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45038.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44702.log.gz 2024-04-14T11:10:20.974 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51292.log.gz 2024-04-14T11:10:20.974 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52325.log 2024-04-14T11:10:20.974 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45038.log.gz 2024-04-14T11:10:20.974 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2024-04-14T11:10:20.974 INFO:teuthology.orchestra.run.smithi084.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43366.log.gz 2024-04-14T11:10:20.974 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-04-14T11:10:20.975 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43450.log 2024-04-14T11:10:20.975 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52325.log.gz 2024-04-14T11:10:20.975 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-04-14T11:10:20.975 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45488.log 2024-04-14T11:10:20.975 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-04-14T11:10:20.975 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45488.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.43450.log.gz -5 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45908.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45488.log.gz 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46960.log 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2024-04-14T11:10:20.976 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45236.log 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46960.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46960.log.gz 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45824.log 2024-04-14T11:10:20.977 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45036.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45236.log.gz 2024-04-14T11:10:20.978 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46552.log 2024-04-14T11:10:20.978 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-04-14T11:10:20.978 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45824.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2024-04-14T11:10:20.978 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2024-04-14T11:10:20.978 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45824.log.gz/var/log/ceph/ceph-client.0.46552.log: 2024-04-14T11:10:20.978 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37238.log 2024-04-14T11:10:20.979 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2024-04-14T11:10:20.979 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37238.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2024-04-14T11:10:20.979 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46750.log 2024-04-14T11:10:20.979 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2024-04-14T11:10:20.979 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37238.log.gz 2024-04-14T11:10:20.979 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46750.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46792.log 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46750.log.gz 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43766.log 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44186.log: /var/log/ceph/ceph-client.admin.46792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51709.log 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43766.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46792.log.gz 2024-04-14T11:10:20.980 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51709.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43766.log.gz 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45974.log 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51709.log.gz 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43322.log 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48886.log 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45974.log: /var/log/ceph/ceph-client.admin.43322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43322.log.gz/var/log/ceph/ceph-client.admin.48886.log: 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47714.log 2024-04-14T11:10:20.981 INFO:teuthology.orchestra.run.smithi084.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45974.log.gz 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.50105.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48886.log.gz 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52493.log 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.1.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.47714.log.gz 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52409.log 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-04-14T11:10:20.982 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52493.log: /var/log/ceph/ceph-client.admin.52409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52493.log.gz 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52409.log.gz 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44699.log 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52367.log: /var/log/ceph/ceph-client.admin.44698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr: 88.6% 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52061.log 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2024-04-14T11:10:20.983 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44699.log.gz 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45530.log 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47356.log 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52061.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45530.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52061.log.gz 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45362.log 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45530.log.gz 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44939.log 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45362.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47356.log.gz 2024-04-14T11:10:20.984 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52083.log 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45362.log.gz 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45740.log 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52083.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44939.log.gz 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45740.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52083.log.gz 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43622.log 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45740.log.gz 2024-04-14T11:10:20.985 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43808.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31208.log 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46040.log 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43622.log.gz 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.tmp-client.admin.31208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49150.log 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31208.log.gz 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44701.log 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46040.log: /var/log/ceph/ceph-client.admin.49150.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-04-14T11:10:20.986 INFO:teuthology.orchestra.run.smithi084.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46040.log.gz 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44701.log.gz 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49150.log.gz 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46834.log 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44364.log 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.49104.log: /var/log/ceph/ceph-client.admin.46834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44697.log 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44367.log 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46834.log.gz 2024-04-14T11:10:20.987 INFO:teuthology.orchestra.run.smithi084.stderr:gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.44364.log.gz --verbose -- 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr: /var/log/ceph/ceph-client.admin.51732.log 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44697.log: /var/log/ceph/ceph-client.admin.44367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45278.log 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44697.log.gz/var/log/ceph/ceph-client.admin.51732.log: 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45572.log 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44367.log.gz 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45656.log 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45278.log.gz 2024-04-14T11:10:20.988 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:gzip/var/log/ceph/ceph-client.admin.45656.log: -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45572.log.gz 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43578.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45656.log.gz 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51591.log 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2024-04-14T11:10:20.989 INFO:teuthology.orchestra.run.smithi084.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47170.log 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.50062.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51591.log.gz 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51508.log 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47170.log: 94.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47170.log.gz 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45782.log 2024-04-14T11:10:20.990 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51508.log: gzip 88.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.46876.log 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51508.log.gz 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48995.log 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr:gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45782.log.gz 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr: -5/var/log/ceph/ceph-client.admin.46876.log: --verbose -- /var/log/ceph/ceph-client.admin.45698.log 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44940.log 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46876.log.gz 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48995.log: /var/log/ceph/ceph-client.admin.45698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45866.log 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44940.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45698.log.gz 2024-04-14T11:10:20.991 INFO:teuthology.orchestra.run.smithi084.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48995.log.gz 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44940.log.gz 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51999.log 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44703.log 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr: 88.9%/var/log/ceph/ceph-client.admin.51999.log: -- replaced with /var/log/ceph/ceph-client.admin.45866.log.gz 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51795.log 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51999.log.gz 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-14T11:10:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44703.log: /var/log/ceph/ceph-client.admin.51795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44102.log 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.0.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51795.log.gz 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47498.log 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44703.log.gz 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51979.log 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44102.log.gz 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51979.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47498.log.gz 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47128.log 2024-04-14T11:10:20.993 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51979.log.gz 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43682.log 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44358.log: /var/log/ceph/ceph-client.admin.47128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47128.log.gz 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44366.log 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43682.log: /var/log/ceph/ceph-client.admin.47086.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43682.log.gz 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gzgzip 2024-04-14T11:10:20.994 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45614.log 2024-04-14T11:10:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52183.log 2024-04-14T11:10:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45614.log: /var/log/ceph/ceph-client.admin.44366.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44366.log.gz 2024-04-14T11:10:20.995 INFO:teuthology.orchestra.run.smithi084.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45614.log.gz 2024-04-14T11:10:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2024-04-14T11:10:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45320.log 2024-04-14T11:10:20.995 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52183.log: /var/log/ceph/ceph-client.admin.44018.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52183.log.gz 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gzgzip 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43280.log 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43280.log: /var/log/ceph/ceph-client.admin.45320.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45320.log.gz 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43280.log.gz 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43976.log 2024-04-14T11:10:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.47646.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43976.log: 87.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43976.log.gz 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43492.log 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-mds.c.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-14T11:10:20.997 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48929.log 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43492.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43492.log.gz 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52182.log 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.48929.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48929.log.gz 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.52182.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52182.log.gz 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44938.log 2024-04-14T11:10:20.998 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37595.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43934.log 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44938.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44938.log.gz 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43934.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43934.log.gz 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43850.log 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46708.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2024-04-14T11:10:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44704.log 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.43850.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43850.log.gz 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46918.log 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.44704.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44704.log.gz 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47002.log 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46918.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46918.log.gz 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37493.log 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47002.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47002.log.gz 2024-04-14T11:10:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47580.log 2024-04-14T11:10:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.37493.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37493.log.gz 2024-04-14T11:10:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2024-04-14T11:10:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47580.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47580.log.gz 2024-04-14T11:10:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51851.log 2024-04-14T11:10:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.46142.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2024-04-14T11:10:21.001 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-14T11:10:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.51851.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51851.log.gz 2024-04-14T11:10:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47254.log 2024-04-14T11:10:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mds.a.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-14T11:10:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45035.log 2024-04-14T11:10:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.47254.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47254.log.gz 2024-04-14T11:10:21.002 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.45035.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45035.log.gz 2024-04-14T11:10:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: 94.0% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-14T11:10:21.009 INFO:teuthology.orchestra.run.smithi084.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-14T11:10:21.019 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-14T11:10:21.129 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-14T11:10:21.131 INFO:teuthology.orchestra.run.smithi175.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-14T11:10:21.390 INFO:teuthology.orchestra.run.smithi084.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-14T11:10:23.520 INFO:teuthology.orchestra.run.smithi084.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-14T11:10:23.985 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-14T11:10:24.160 INFO:teuthology.orchestra.run.smithi175.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-14T11:10:24.840 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-14T11:10:25.263 INFO:teuthology.orchestra.run.smithi175.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-14T11:10:25.347 INFO:teuthology.orchestra.run.smithi084.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-14T11:10:26.183 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-14T11:10:26.453 INFO:teuthology.orchestra.run.smithi175.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-14T11:10:38.959 INFO:teuthology.orchestra.run.smithi175.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-14T11:10:38.961 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-14T11:10:38.961 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m18.064s 2024-04-14T11:10:38.961 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m33.612s 2024-04-14T11:10:38.961 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m1.117s 2024-04-14T11:11:15.238 INFO:teuthology.orchestra.run.smithi084.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.0.46552.log.gz 2024-04-14T11:11:15.240 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-14T11:11:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m54.374s 2024-04-14T11:11:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:user 1m8.700s 2024-04-14T11:11:15.240 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m2.537s 2024-04-14T11:11:15.240 INFO:tasks.ceph:Archiving logs... 2024-04-14T11:11:15.241 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/remote/smithi084/log 2024-04-14T11:11:15.242 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T11:11:24.905 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/remote/smithi175/log 2024-04-14T11:11:24.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T11:11:44.633 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 294, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 247, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph.py", line 1242, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi084 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-14T11:11:44.650 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-14T11:11:44.660 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 294, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_605eb1656ce49fe7fede4f53b18852ac638918c7/qa/tasks/quiescer.py", line 247, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) 2024-04-14T11:11:44.673 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-14T11:11:44.673 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T11:11:44.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T11:11:44.764 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-14T11:11:44.774 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-14T11:11:44.774 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T11:11:44.777 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T11:11:44.791 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-04-14T11:11:44.794 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-14T11:11:44.795 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T11:11:44.796 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-04-14T11:11:44.796 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +959us[ +979us] +/- 42ms 2024-04-14T11:11:44.796 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -981us[ -981us] +/- 62ms 2024-04-14T11:11:44.796 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -503us[ -503us] +/- 79ms 2024-04-14T11:11:44.796 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T11:11:44.800 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T11:11:44.800 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-14T11:11:44.800 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +948us[ +928us] +/- 42ms 2024-04-14T11:11:44.800 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -996us[ -996us] +/- 62ms 2024-04-14T11:11:44.800 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -525us[ -525us] +/- 79ms 2024-04-14T11:11:44.800 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T11:11:44.801 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-14T11:11:44.809 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-14T11:11:44.810 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-14T11:11:44.820 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T11:11:44.913 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T11:11:44.985 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T11:11:45.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T11:11:45.017 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T11:11:45.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T11:11:45.049 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-14T11:11:45.060 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-14T11:11:45.070 INFO:teuthology.task.internal:Duration was 1282.238778 seconds 2024-04-14T11:11:45.071 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-14T11:11:45.080 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-14T11:11:45.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T11:11:45.083 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T11:11:45.125 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T11:11:45.134 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T11:11:45.417 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-14T11:11:45.418 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-04-14T11:11:45.418 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T11:11:45.438 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-14T11:11:45.439 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T11:11:45.474 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-14T11:11:45.475 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T11:11:45.481 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T11:11:45.544 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-14T11:11:45.545 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T11:11:45.550 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T11:11:45.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-14T11:11:45.695 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-14T11:11:45.695 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T11:11:45.723 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T11:11:45.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-14T11:11:45.762 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T11:11:45.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T11:11:45.788 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-04-14T11:11:45.816 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-14T11:11:45.838 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T11:11:45.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T11:11:45.859 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T11:11:45.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T11:11:45.892 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-14T11:11:45.903 INFO:teuthology.task.internal:Transferring archived files... 2024-04-14T11:11:45.903 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/remote/smithi084 2024-04-14T11:11:45.904 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T11:11:45.940 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737/remote/smithi175 2024-04-14T11:11:45.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T11:11:45.975 INFO:teuthology.task.internal:Removing archive directory... 2024-04-14T11:11:45.975 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T11:11:45.977 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T11:11:46.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-14T11:11:46.036 INFO:teuthology.task.internal:Not uploading archives. 2024-04-14T11:11:46.036 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-14T11:11:46.046 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-14T11:11:46.047 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T11:11:46.052 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T11:11:46.063 INFO:teuthology.orchestra.run.smithi084.stdout: 265306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 11:11 /home/ubuntu/cephtest 2024-04-14T11:11:46.078 INFO:teuthology.orchestra.run.smithi175.stdout: 265541 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 11:11 /home/ubuntu/cephtest 2024-04-14T11:11:46.080 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-14T11:11:46.090 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-14T11:11:46.101 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: Error quiescing root: -124 (EMEDIUMTYPE) 2024-04-14T11:11:46.102 INFO:teuthology.nuke:Checking targets against current locks 2024-04-14T11:11:46.129 DEBUG:teuthology.nuke:shortname: smithi084 2024-04-14T11:11:46.129 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T11:11:46.153 DEBUG:teuthology.nuke:shortname: smithi175 2024-04-14T11:11:46.153 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T11:11:46.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 10:42:00.065194', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuXgyYh0ntcjU8Q459AY3n7Iy8nRUlizN+SFU6IxhlTAdkPxg7SdyoP2RcWQcndzZPIILjYaPUOOxHUJyDl7nI='} 2024-04-14T11:11:46.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-14_10:39:28-fs-wip-lusov-quiescer-distro-default-smithi/7655737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 10:42:00.067083', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHxc0VyijjfhsK9GoLH1aUcoMgGCukbOhBrp6uQVoaAN6ShVhDEAB+e4WE/d0UYQAt1wM/kPxZaa+m59lxNS3c='} 2024-04-14T11:11:46.213 INFO:teuthology.orchestra.console.smithi084:Power off 2024-04-14T11:11:46.214 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T11:11:46.238 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-04-14T11:11:46.238 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:46.257 INFO:teuthology.orchestra.console.smithi175:Power off 2024-04-14T11:11:46.258 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T11:11:46.269 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-04-14T11:11:46.281 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-04-14T11:11:46.281 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:46.307 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-14T11:11:50.270 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:50.308 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:50.381 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-04-14T11:11:50.418 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-14T11:11:54.386 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:54.420 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:54.497 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-14T11:11:54.531 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-14T11:11:54.598 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-04-14T11:11:58.536 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T11:11:58.646 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-14T11:11:58.747 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-04-14T11:11:58.854 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds-quiesce 2-workunit/fs/snaps}} duration: 1282.2387776374817 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi084 with status 128: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=605eb1656ce49fe7fede4f53b18852ac638918c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=91ca3e1597fe43c585d58ea54183875b status: fail success: false 2024-04-14T11:11:58.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T11:11:58.944 INFO:teuthology.run:FAIL